search

openshift / openshift-ansible

Install and config an OpenShift 3.x cluster
https://try.openshift.com
Apache License 2.0
2.18k stars 2.31k forks source link

Unable to add OpenStack Cloud provider post-install #3790

Closed etsauer closed 4 years ago

etsauer commented 7 years ago

Description

I'm trying to add an OpenStack cloud provider to an existing healthy cluster. I run the initial install using playbooks/byo/config.yml, all nodes come up successfully, and then add the following to my hosts file:

openshift_cloudprovider_kind=openstack
openshift_cloudprovider_openstack_auth_url=http://10.9.50.6:5000/v3
openshift_cloudprovider_openstack_username="{{ lookup('env','OCP_OSP_USERNAME') }}"
openshift_cloudprovider_openstack_password="{{ lookup('env','OCP_OSP_PASSWORD') }}"
openshift_cloudprovider_openstack_domain_name=Default
openshift_cloudprovider_openstack_tenant_id=220ba500f3334c6b839453bbcefba1b8
openshift_cloudprovider_openstack_tenant_name=esauer
openshift_cloudprovider_openstack_region=RegionOne
openshift_cloudprovider_openstack_lb_subnet_id=98576f89-2881-46c1-963f-f7357d16c56a

After re-running the playbook, my nodes are marked as NotReady:

[root@master-0 ~]# oc get nodes
NAME                               STATUS                        AGE
app-node-0.l1.casl.rht-labs.com    NotReady                      2h
app-node-1.l1.casl.rht-labs.com    NotReady                      2h
infranode-0.l1.casl.rht-labs.com   NotReady                      2h
master-0.l1.casl.rht-labs.com      NotReady,SchedulingDisabled   2h

Here's an excerpt of the startup log for a node:

Mar 28 18:40:22 master-0.l1.casl.rht-labs.com systemd[1]: Starting Atomic OpenShift Node...
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.046469  110689 docker.go:330] Start docker client with request timeout=2m0s
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.192625  110689 node_config.go:274] Successfully initialized cloud provider: "openstack" from the config file: "/etc/origin/cloudprovider/openstack.conf"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.192648  110689 node.go:42] Initializing SDN node of type "redhat/openshift-ovs-subnet" with configured hostname "master-0.l1.casl.rht-labs.com" (IP ""), iptables sync period "30s"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.193500  110689 start_node.go:298] Starting node master-0.l1.casl.rht-labs.com (v3.3.1.11)
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.194905  110689 start_node.go:307] Connecting to API server https://master-0.l1.casl.rht-labs.com:8443
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.196508  110689 docker.go:310] Connecting to docker on unix:///var/run/docker.sock
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.196535  110689 docker.go:330] Start docker client with request timeout=0
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.199783  110689 node.go:138] Connecting to Docker at unix:///var/run/docker.sock
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.233508  110689 manager.go:138] cAdvisor running in container: "/system.slice/atomic-openshift-node.service"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.246262  110689 subnets.go:256] Found local HostSubnet master-0.l1.casl.rht-labs.com (host: "master-0.l1.casl.rht-labs.com", ip: "192.168.99.10", subnet: "10.130.0.0/23")
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.254026  110689 controller.go:544] AddHostSubnetRules for app-node-0.l1.casl.rht-labs.com (host: "app-node-0.l1.casl.rht-labs.com", ip: "192.168.99.15", subnet: "10.128.0.0/23")
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.255399  110689 node.go:380] Using iptables Proxier.
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.255469  110689 proxier.go:209] missing br-netfilter module or unset br-nf-call-iptables; proxy may not work as intended
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.255509  110689 node.go:396] Tearing down userspace rules.
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.269525  110689 controller.go:544] AddHostSubnetRules for app-node-1.l1.casl.rht-labs.com (host: "app-node-1.l1.casl.rht-labs.com", ip: "192.168.99.9", subnet: "10.131.0.0/23")
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.282858  110689 controller.go:544] AddHostSubnetRules for infranode-0.l1.casl.rht-labs.com (host: "infranode-0.l1.casl.rht-labs.com", ip: "192.168.99.11", subnet: "10.129.0.0/23")
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: W0328 18:40:23.310984  110689 manager.go:146] unable to connect to Rkt api service: rkt: cannot tcp Dial rkt api service: dial tcp [::1]:15441: getsockopt: connection refused
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.313353  110689 proxier.go:177] Setting proxy IP to 192.168.99.10 and initializing iptables
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.337774  110689 node.go:479] Started Kubernetes Proxy on 0.0.0.0
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.359527  110689 roundrobin.go:273] LoadBalancerRR: Setting endpoints for default/registry-console:registry-console to [10.131.0.5:9090]
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.359574  110689 roundrobin.go:273] LoadBalancerRR: Setting endpoints for default/router:443-tcp to [192.168.99.11:443]
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.359584  110689 roundrobin.go:273] LoadBalancerRR: Setting endpoints for default/router:1936-tcp to [192.168.99.11:1936]
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.359592  110689 roundrobin.go:273] LoadBalancerRR: Setting endpoints for default/router:80-tcp to [192.168.99.11:80]
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.359599  110689 roundrobin.go:273] LoadBalancerRR: Setting endpoints for default/docker-registry:5000-tcp to [10.129.0.5:5000]
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.359609  110689 roundrobin.go:273] LoadBalancerRR: Setting endpoints for default/kubernetes:dns to [192.168.99.10:8053]
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.359616  110689 roundrobin.go:273] LoadBalancerRR: Setting endpoints for default/kubernetes:https to [192.168.99.10:8443]
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.359623  110689 roundrobin.go:273] LoadBalancerRR: Setting endpoints for default/kubernetes:dns-tcp to [192.168.99.10:8053]
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.359652  110689 proxier.go:502] Setting endpoints for "default/registry-console:registry-console" to [10.131.0.5:9090]
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.359664  110689 proxier.go:502] Setting endpoints for "default/router:1936-tcp" to [192.168.99.11:1936]
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.359671  110689 proxier.go:502] Setting endpoints for "default/router:80-tcp" to [192.168.99.11:80]
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.359678  110689 proxier.go:502] Setting endpoints for "default/router:443-tcp" to [192.168.99.11:443]
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.359686  110689 proxier.go:502] Setting endpoints for "default/docker-registry:5000-tcp" to [10.129.0.5:5000]
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.359694  110689 proxier.go:502] Setting endpoints for "default/kubernetes:https" to [192.168.99.10:8443]
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.359701  110689 proxier.go:502] Setting endpoints for "default/kubernetes:dns-tcp" to [192.168.99.10:8053]
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.359708  110689 proxier.go:502] Setting endpoints for "default/kubernetes:dns" to [192.168.99.10:8053]
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.359725  110689 proxier.go:647] Not syncing iptables until Services and Endpoints have been received from master
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.391169  110689 proxier.go:427] Adding new service "default/kubernetes:https" at 172.30.0.1:443/TCP
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.391347  110689 proxier.go:427] Adding new service "default/kubernetes:dns" at 172.30.0.1:53/UDP
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.391373  110689 proxier.go:427] Adding new service "default/kubernetes:dns-tcp" at 172.30.0.1:53/TCP
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.391397  110689 proxier.go:427] Adding new service "default/registry-console:registry-console" at 172.30.214.188:9000/TCP
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.391416  110689 proxier.go:427] Adding new service "default/router:80-tcp" at 172.30.164.183:80/TCP
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.391436  110689 proxier.go:427] Adding new service "default/router:443-tcp" at 172.30.164.183:443/TCP
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.391464  110689 proxier.go:427] Adding new service "default/router:1936-tcp" at 172.30.164.183:1936/TCP
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.391481  110689 proxier.go:427] Adding new service "default/docker-registry:5000-tcp" at 172.30.157.107:5000/TCP
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.393798  110689 fs.go:116] Filesystem partitions: map[/dev/vda1:{mountpoint:/ major:253 minor:1 fsType:xfs blockSize:0} docker_vg-docker--pool:{mountpoint: major:252 minor:1 fsType:devicemapper blockSize:1024}]
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.403866  110689 manager.go:192] Machine: {NumCores:2 CpuFrequency:2299996 MemoryCapacity:3975086080 MachineID:6d48b4ed994e4baa915236703275389b SystemUUID:42404D7B-A4D4-4D6D-BB07-4B87AE146DC2 BootID:5dbe902d-b8e3-44fd-be91-64757d080b9c Filesystems:[{Device:docker_vg-docker--pool Capacity:4265607168 Type:devicemapper Inodes:0} {Device:/dev/vda1 Capacity:42931007488 Type:vfs Inodes:20967520}] DiskMap:map[252:0:{Name:dm-0 Major:252 Minor:0 Size:12582912 Scheduler:none} 252:1:{Name:dm-1 Major:252 Minor:1 Size:4265607168 Scheduler:none} 252:2:{Name:dm-2 Major:252 Minor:2 Size:4265607168 Scheduler:none} 253:0:{Name:vda Major:253 Minor:0 Size:42949672960 Scheduler:none} 253:16:{Name:vdb Major:253 Minor:16 Size:10737418240 Scheduler:none}] NetworkDevices:[{Name:br0 MacAddress:b6:e5:ce:c9:07:4e Speed:0 Mtu:1400} {Name:eth0 MacAddress:fa:16:3e:40:36:1b Speed:0 Mtu:1450} {Name:lbr0 MacAddress:b6:49:a0:d6:43:bd Speed:0 Mtu:1400} {Name:ovs-system MacAddress:ea:7e:d0:5b:21:1f Speed:0 Mtu:1500} {Name:tun0 MacAddress:d2:38:5f:77:45:69 Speed:0 Mtu:1400} {Name:vlinuxbr MacAddress:b6:49:a0:d6:43:bd Speed:10000 Mtu:1400} {Name:vovsbr MacAddress:ee:7b:7f:45:4a:93 Speed:10000 Mtu:1400} {Name:vxlan_sys_4789 MacAddress:d2:6d:1b:9a:4e:f1 Speed:0 Mtu:65470}] Topology:[{Id:0 Memory:4294418432 Cores:[{Id:0 Threads:[0] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:4194304 Type:Unified Level:2}]}] Caches:[]} {Id:1 Memory:0 Cores:[{Id:0 Threads:[1] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:4194304 Type:Unified Level:2}]}] Caches:[]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.435284  110689 manager.go:198] Version: {KernelVersion:3.10.0-514.el7.x86_64 ContainerOsVersion:Employee SKU DockerVersion:1.12.6 CadvisorVersion: CadvisorRevision:}
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.435854  110689 server.go:383] Using root directory: /var/lib/origin/openshift.local.volumes
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.435973  110689 server.go:769] Watching apiserver
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.436069  110689 kubelet.go:387] Hairpin mode set to "none"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.436115  110689 plugins.go:141] Loaded network plugin "redhat/openshift-ovs-subnet"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com systemd[1]: Started Atomic OpenShift Node.
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.483081  110689 docker_manager.go:236] Setting dockerRoot to /var/lib/docker
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.483267  110689 plugins.go:343] Loaded volume plugin "kubernetes.io/aws-ebs"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.483280  110689 plugins.go:343] Loaded volume plugin "kubernetes.io/empty-dir"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.483288  110689 plugins.go:343] Loaded volume plugin "kubernetes.io/gce-pd"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.483310  110689 plugins.go:343] Loaded volume plugin "kubernetes.io/git-repo"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.483331  110689 plugins.go:343] Loaded volume plugin "kubernetes.io/host-path"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.483349  110689 plugins.go:343] Loaded volume plugin "kubernetes.io/nfs"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.483356  110689 plugins.go:343] Loaded volume plugin "kubernetes.io/secret"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.483364  110689 plugins.go:343] Loaded volume plugin "kubernetes.io/iscsi"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.483372  110689 plugins.go:343] Loaded volume plugin "kubernetes.io/glusterfs"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.483379  110689 plugins.go:343] Loaded volume plugin "kubernetes.io/rbd"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.483387  110689 plugins.go:343] Loaded volume plugin "kubernetes.io/cinder"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.483393  110689 plugins.go:343] Loaded volume plugin "kubernetes.io/cephfs"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.483401  110689 plugins.go:343] Loaded volume plugin "kubernetes.io/downward-api"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.483409  110689 plugins.go:343] Loaded volume plugin "kubernetes.io/fc"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.483416  110689 plugins.go:343] Loaded volume plugin "kubernetes.io/flocker"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.483422  110689 plugins.go:343] Loaded volume plugin "kubernetes.io/azure-file"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.483429  110689 plugins.go:343] Loaded volume plugin "kubernetes.io/configmap"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.483436  110689 plugins.go:343] Loaded volume plugin "kubernetes.io/vsphere-volume"
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.516410  110689 server.go:731] Started kubelet v1.3.0+52492b4
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.516441  110689 server.go:118] Starting to listen on 0.0.0.0:10250
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: E0328 18:40:23.516653  110689 kubelet.go:958] Image garbage collection failed: unable to find data for container /
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.517349  110689 fs_resource_analyzer.go:66] Starting FS ResourceAnalyzer
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.517368  110689 status_manager.go:123] Starting to sync pod status with apiserver
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.517393  110689 kubelet.go:2587] Starting kubelet main sync loop.
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.517399  110689 kubelet.go:2596] skipping pod synchronization - [network state unknown container runtime is down]
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.517818  110689 container_manager_linux.go:284] Discovered runtime cgroups name: /system.slice/docker.service
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.517878  110689 volume_manager.go:225] The desired_state_of_world populator starts
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.517883  110689 volume_manager.go:227] Starting Kubelet Volume Manager
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.578545  110689 factory.go:295] Registering Docker factory
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: E0328 18:40:23.578566  110689 manager.go:240] Registration of the rkt container factory failed: unable to communicate with Rkt api service: rkt: cannot tcp Dial rkt api service: dial tcp [::1]:15441: getsockopt: connection refused
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.578573  110689 factory.go:54] Registering systemd factory
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.578911  110689 factory.go:86] Registering Raw factory
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.579248  110689 manager.go:1072] Started watching for new ooms in manager
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.582050  110689 oomparser.go:185] oomparser using systemd
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.582831  110689 manager.go:281] Starting recovery of all containers
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.627888  110689 kubelet.go:1091] Controller attach/detach is disabled for this node; Kubelet will attach and detach volumes
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.637240  110689 manager.go:286] Recovery completed
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.685125  110689 openstack.go:290] Claiming to support Instances
Mar 28 18:40:23 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:23.932695  110689 openstack.go:290] Claiming to support Instances
Mar 28 18:40:24 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:24.140731  110689 openstack.go:545] Claiming to support Zones
Mar 28 18:40:24 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:24.140761  110689 openstack.go:550] Current zone is RegionOne
Mar 28 18:40:24 master-0.l1.casl.rht-labs.com atomic-openshift-node[110689]: I0328 18:40:24.140767  110689 kubelet.go:1145] Adding node label from cloud provider: failure-domain.beta.kubernetes.io/region=RegionOne
Version
ansible --version 
ansible 2.3.0
  config file = /root/.ansible.cfg
  configured module search path = Default w/o overrides
git describe
openshift-ansible-3.4.60-1-2-gbc364ec
etsauer commented 7 years ago

cc: @sdodson

fwiw, if I run a clean install WITH the cloud provider defined as above, everything works as expected.

openshift-bot commented 4 years ago

Issues go stale after 90d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle stale. Stale issues rot after an additional 30d of inactivity and eventually close. Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle stale

openshift-bot commented 4 years ago

Stale issues rot after 30d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle rotten. Rotten issues close after an additional 30d of inactivity. Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle rotten /remove-lifecycle stale

openshift-bot commented 4 years ago

Rotten issues close after 30d of inactivity.

Reopen the issue by commenting /reopen. Mark the issue as fresh by commenting /remove-lifecycle rotten. Exclude this issue from closing again by commenting /lifecycle frozen.

/close

openshift-ci-robot commented 4 years ago

@openshift-bot: Closing this issue.

In response to [this](https://github.com/openshift/openshift-ansible/issues/3790#issuecomment-658354221): >Rotten issues close after 30d of inactivity. > >Reopen the issue by commenting `/reopen`. >Mark the issue as fresh by commenting `/remove-lifecycle rotten`. >Exclude this issue from closing again by commenting `/lifecycle frozen`. > >/close Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.