redhat-openstack / infrared

Plugin based framework that aims to provide an easy-to-use CLI for Ansible based projects
https://infrared.readthedocs.io/en/latest/index.html
Apache License 2.0
99 stars 96 forks source link

Overcloud deployment failed for openstack queens using infrared. #326

Open Kosal-Raj opened 6 years ago

Kosal-Raj commented 6 years ago

Issue: Overcloud deployment failed for openstack queens using infrared.

TASK [fail] **** fatal: [undercloud-0]: FAILED! => {"changed": false, "msg": "Overcloud deployment failed... :("}

NO MORE HOSTS LEFT ***** to retry, use: --limit @/root/.venv_infrared/infrared/plugins/tripleo-overcloud/main.retry

PLAY RECAP ***** hypervisor : ok=2 changed=0 unreachable=0 failed=0
localhost : ok=4 changed=1 unreachable=0 failed=0
undercloud-0 : ok=157 changed=73 unreachable=0 failed=1

ERROR Playbook "/root/.venv_infrared/infrared/plugins/tripleo-overcloud/main.yml" failed!

[root@dell-m620-4 ~]# ssh stack@undercloud-0 Last login: Wed May 2 07:55:36 2018 from gateway [stack@undercloud-0 ~]$ [stack@undercloud-0 ~]$ [stack@undercloud-0 ~]$ source stackrc (undercloud) [stack@undercloud-0 ~]$ (undercloud) [stack@undercloud-0 ~]$ (undercloud) [stack@undercloud-0 ~]$ openstack stack list +--------------------------------------+------------+----------------------------------+-----------------+----------------------+--------------+ | ID | Stack Name | Project | Stack Status | Creation Time | Updated Time | +--------------------------------------+------------+----------------------------------+-----------------+----------------------+--------------+ | 086c6f3e-b906-4dea-b2d9-1980af153bf2 | overcloud | ed7a4de66dc74f9d9b5a768ca07df409 | CREATE_COMPLETE | 2018-05-02T07:23:15Z | None | +--------------------------------------+------------+----------------------------------+-----------------+----------------------+--------------+ (undercloud) [stack@undercloud-0 ~]$ (undercloud) [stack@undercloud-0 ~]$ (undercloud) [stack@undercloud-0 ~]$ openstack stack failures list --long overcloud (undercloud) [stack@undercloud-0 ~]$ (undercloud) [stack@undercloud-0 ~]$ (undercloud) [stack@undercloud-0 ~]$ nova list +--------------------------------------+--------------+--------+------------+-------------+-----------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+--------------+--------+------------+-------------+-----------------------+ | 8dac4b3a-9eba-4f1b-92b2-4a03d63c1bbb | compute-0 | ACTIVE | - | Running | ctlplane=192.168.24.7 | | 3c20b1b1-b0a3-4f7d-a1e5-a694e8f362ab | controller-0 | ACTIVE | - | Running | ctlplane=192.168.24.9 | +--------------------------------------+--------------+--------+------------+-------------+-----------------------+ (undercloud) [stack@undercloud-0 ~]$ (undercloud) [stack@undercloud-0 ~]$ (undercloud) [stack@undercloud-0 ~]$ ssh heat-admin@192.168.24.9 Last login: Wed May 2 07:36:48 2018 from 192.168.24.1 [heat-admin@controller-0 ~]$ [heat-admin@controller-0 ~]$ sudo su - [root@controller-0 ~]# [root@controller-0 ~]# cat /var/log/messages | grep -i error May 2 07:38:14 localhost os-collect-config: HTTPConnectionPool(host='192.168.24.3', port=8080): Max retries exceeded with url: /v1/AUTH_ed7a4de66dc74f9d9b5a768ca07df409/ov-lol4kuhtasw-0-t47datvqb3ez-Controller-j6lbxhsgc7pq/428f957e-818d-4ce5-aa95-0b67af9c1bca?temp_url_sig=e631bb0a008ebe488e78945493295958aa48d3ac&temp_url_expires=2147483586 (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x3f46990>: Failed to establish a new connection: [Errno 111] Connection refused',)) May 2 07:43:45 localhost container-storage-setup: ERROR: Storage is already configured with o driver. Can't configure it with overlay2 driver. To override, remove /etc/sysconfig/docker-storage and retry. May 2 07:43:46 localhost dockerd-current: time="2018-05-02T07:43:46.221728400Z" level=debug msg="libcontainerd: containerd health check returned error: rpc error: code = 14 desc = grpc: the connection is unavailable" May 2 07:44:04 localhost dockerd-current: time="2018-05-02T07:44:04.876582783Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-mysql returned error: No such container: docker-puppet-mysql" May 2 07:44:04 localhost dockerd-current: time="2018-05-02T07:44:04.876802236Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-heat_api returned error: No such container: docker-puppet-heat_api" May 2 07:44:04 localhost dockerd-current: time="2018-05-02T07:44:04.878250867Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-nova_placement returnederror: No such container: docker-puppet-nova_placement" May 2 07:44:04 localhost dockerd-current: time="2018-05-02T07:44:04.911340268Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-heat-api:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-heat-api:current-tripleo" May 2 07:44:04 localhost dockerd-current: time="2018-05-02T07:44:04.912428162Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-heat-api:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-heat-api:current-tripleo" May 2 07:44:04 localhost dockerd-current: time="2018-05-02T07:44:04.912851838Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-mariadb:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-mariadb:current-tripleo" May 2 07:44:04 localhost dockerd-current: time="2018-05-02T07:44:04.914351168Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-heat-api:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-heat-api:current-tripleo not found" May 2 07:44:04 localhost dockerd-current: time="2018-05-02T07:44:04.916708871Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-heat-api:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-heat-api:current-tripleo: no such volume" May 2 07:44:04 localhost dockerd-current: time="2018-05-02T07:44:04.917235119Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-mariadb:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-mariadb:current-tripleo" May 2 07:44:04 localhost dockerd-current: time="2018-05-02T07:44:04.920012711Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-mariadb:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-mariadb:current-tripleo not found" May 2 07:44:04 localhost dockerd-current: time="2018-05-02T07:44:04.921414731Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-mariadb:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-mariadb:current-tripleo: no such volume" May 2 07:44:04 localhost dockerd-current: time="2018-05-02T07:44:04.935341168Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-nova-placement-api:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-nova-placement-api:current-tripleo" May 2 07:44:04 localhost dockerd-current: time="2018-05-02T07:44:04.936137729Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-nova-placement-api:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-nova-placement-api:current-tripleo" May 2 07:44:04 localhost dockerd-current: time="2018-05-02T07:44:04.937794055Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-nova-placement-api:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-nova-placement-api:current-tripleo not found" May 2 07:44:04 localhost dockerd-current: time="2018-05-02T07:44:04.938918623Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-nova-placement-api:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-nova-placement-api:current-tripleo: no such volume" May 2 07:44:04 localhost dockerd-current: time="2018-05-02T07:44:04.943329275Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-mariadb:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-mariadb:current-tripleo\" not found" May 2 07:44:04 localhost dockerd-current: time="2018-05-02T07:44:04.948193634Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-heat-api:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-heat-api:current-tripleo\" not found" May 2 07:44:04 localhost dockerd-current: time="2018-05-02T07:44:04.950398846Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-nova-placement-api:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-nova-placement-api:current-tripleo\" not found" May 2 07:46:24 localhost dockerd-current: time="2018-05-02T07:46:24.381016212Z" level=error msg="containerd: deleting container" error="exit status 1: \"container 3833380ff2628a7fbf442ea62f589972ff91962bada6045d2cedf00f3d5afb2a does not exist\none or more of the container deletions failed\n\"" May 2 07:46:24 localhost dockerd-current: time="2018-05-02T07:46:24.502485487Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-gnocchi returned error: No such container: docker-puppet-gnocchi" May 2 07:46:24 localhost dockerd-current: time="2018-05-02T07:46:24.560602813Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-gnocchi-api:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-gnocchi-api:current-tripleo" May 2 07:46:24 localhost dockerd-current: time="2018-05-02T07:46:24.563091867Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-gnocchi-api:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-gnocchi-api:current-tripleo" May 2 07:46:24 localhost dockerd-current: time="2018-05-02T07:46:24.566352579Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-gnocchi-api:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-gnocchi-api:current-tripleo not found" May 2 07:46:24 localhost dockerd-current: time="2018-05-02T07:46:24.568637153Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-gnocchi-api:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-gnocchi-api:current-tripleo: no such volume" May 2 07:46:24 localhost dockerd-current: time="2018-05-02T07:46:24.592017146Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-gnocchi-api:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-gnocchi-api:current-tripleo\" not found" May 2 07:46:27 localhost dockerd-current: time="2018-05-02T07:46:27.276981491Z" level=error msg="containerd: deleting container" error="exit status 1: \"container fe7496a09762400e5369e6a48e3b52472d537495919a3420397cd461dff6e660 does not exist\none or more of the container deletions failed\n\"" May 2 07:46:27 localhost dockerd-current: time="2018-05-02T07:46:27.378985934Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-swift_ringbuilder returned error: No such container: docker-puppet-swift_ringbuilder" May 2 07:46:27 localhost dockerd-current: time="2018-05-02T07:46:27.411213057Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-swift-proxy-server:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-swift-proxy-server:current-tripleo" May 2 07:46:27 localhost dockerd-current: time="2018-05-02T07:46:27.412199899Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-swift-proxy-server:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-swift-proxy-server:current-tripleo" May 2 07:46:27 localhost dockerd-current: time="2018-05-02T07:46:27.413529298Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-swift-proxy-server:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-swift-proxy-server:current-tripleo not found" May 2 07:46:27 localhost dockerd-current: time="2018-05-02T07:46:27.414332011Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-swift-proxy-server:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-swift-proxy-server:current-tripleo: no such volume" May 2 07:46:27 localhost dockerd-current: time="2018-05-02T07:46:27.430976533Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-swift-proxy-server:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-swift-proxy-server:current-tripleo\" not found" May 2 07:46:33 localhost dockerd-current: time="2018-05-02T07:46:33.221990505Z" level=error msg="containerd: deleting container" error="exit status 1: \"container 36135a942b98b767701d3bc14949a15955ab6ff1158ab72b04593464fe8de46e does not exist\none or more of the container deletions failed\n\"" May 2 07:46:33 localhost dockerd-current: time="2018-05-02T07:46:33.315941852Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-aodh returned error: No such container: docker-puppet-aodh" May 2 07:46:33 localhost dockerd-current: time="2018-05-02T07:46:33.341351825Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-aodh-api:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-aodh-api:current-tripleo" May 2 07:46:33 localhost dockerd-current: time="2018-05-02T07:46:33.342247956Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-aodh-api:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-aodh-api:current-tripleo" May 2 07:46:33 localhost dockerd-current: time="2018-05-02T07:46:33.343218220Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-aodh-api:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-aodh-api:current-tripleo not found" May 2 07:46:33 localhost dockerd-current: time="2018-05-02T07:46:33.344112740Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-aodh-api:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-aodh-api:current-tripleo: no such volume" May 2 07:46:33 localhost dockerd-current: time="2018-05-02T07:46:33.361525950Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-aodh-api:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-aodh-api:current-tripleo\" not found" May 2 07:47:41 localhost dockerd-current: time="2018-05-02T07:47:41.252659252Z" level=error msg="containerd: deleting container" error="exit status 1: \"container 15722c0496b74c5cab7cb2e8f64286360891789c30f88e1767cb484a927e8f3f does not exist\none or more of the container deletions failed\n\"" May 2 07:47:41 localhost dockerd-current: time="2018-05-02T07:47:41.343395356Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-redis returned error: No such container: docker-puppet-redis" May 2 07:47:41 localhost dockerd-current: time="2018-05-02T07:47:41.369845716Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-redis:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-redis:current-tripleo" May 2 07:47:41 localhost dockerd-current: time="2018-05-02T07:47:41.370622657Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-redis:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-redis:current-tripleo" May 2 07:47:41 localhost dockerd-current: time="2018-05-02T07:47:41.371467922Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-redis:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-redis:current-tripleo not found" May 2 07:47:41 localhost dockerd-current: time="2018-05-02T07:47:41.372160180Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-redis:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-redis:current-tripleo: no such volume" May 2 07:47:41 localhost dockerd-current: time="2018-05-02T07:47:41.389190245Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-redis:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-redis:current-tripleo\" not found" May 2 07:48:15 localhost dockerd-current: time="2018-05-02T07:48:15.210563486Z" level=error msg="containerd: deleting container" error="exit status 1: \"container bb0e9627e478b05af68079fc975a677178d77321c890a064c2d3a908516c7341 does not exist\none or more of the container deletions failed\n\"" May 2 07:48:15 localhost dockerd-current: time="2018-05-02T07:48:15.301151467Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-nova returned error: No such container: docker-puppet-nova" May 2 07:48:15 localhost dockerd-current: time="2018-05-02T07:48:15.326050310Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-nova-api:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-nova-api:current-tripleo" May 2 07:48:15 localhost dockerd-current: time="2018-05-02T07:48:15.326921153Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-nova-api:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-nova-api:current-tripleo" May 2 07:48:15 localhost dockerd-current: time="2018-05-02T07:48:15.328126752Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-nova-api:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-nova-api:current-tripleo not found" May 2 07:48:15 localhost dockerd-current: time="2018-05-02T07:48:15.328950998Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-nova-api:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-nova-api:current-tripleo: no such volume" May 2 07:48:15 localhost dockerd-current: time="2018-05-02T07:48:15.348619384Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-nova-api:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-nova-api:current-tripleo\" not found" May 2 07:48:39 localhost puppet-user[13]: (Scope(Class[Gnocchi::Logging])) gnocchi::logging::publish_errors is deprecated and will be removed in future May 2 07:48:39 localhost journal: Warning: Scope(Class[Gnocchi::Logging]): gnocchi::logging::publish_errors is deprecated and will be removed in future May 2 07:48:48 localhost dockerd-current: time="2018-05-02T07:48:48.845862725Z" level=error msg="containerd: deleting container" error="exit status 1: \"container fec6ccfe698986350a2ba8818642f32133d0c26d8ea8d1115ede477fef060f0d does not exist\none or more of the container deletions failed\n\"" May 2 07:48:48 localhost dockerd-current: time="2018-05-02T07:48:48.938072075Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-glance_api returned error: No such container: docker-puppet-glance_api" May 2 07:48:48 localhost dockerd-current: time="2018-05-02T07:48:48.963867675Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-glance-api:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-glance-api:current-tripleo" May 2 07:48:48 localhost dockerd-current: time="2018-05-02T07:48:48.964862693Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-glance-api:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-glance-api:current-tripleo" May 2 07:48:48 localhost dockerd-current: time="2018-05-02T07:48:48.965921195Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-glance-api:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-glance-api:current-tripleo not found" May 2 07:48:48 localhost dockerd-current: time="2018-05-02T07:48:48.966980481Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-glance-api:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-glance-api:current-tripleo: no such volume" May 2 07:48:48 localhost dockerd-current: time="2018-05-02T07:48:48.987425318Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-glance-api:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-glance-api:current-tripleo\" not found" May 2 07:48:59 localhost dockerd-current: time="2018-05-02T07:48:59.041797315Z" level=error msg="containerd: deleting container" error="exit status 1: \"container 8d8273fc5d6ccd5e6e4dc5e6697e327568bea824d0fbeb07bbdfe3635be42937 does not exist\none or more of the container deletions failed\n\"" May 2 07:48:59 localhost dockerd-current: time="2018-05-02T07:48:59.123620738Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-keepalived returned error: No such container: docker-puppet-keepalived" May 2 07:48:59 localhost dockerd-current: time="2018-05-02T07:48:59.148905508Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-keepalived:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-keepalived:current-tripleo" May 2 07:48:59 localhost dockerd-current: time="2018-05-02T07:48:59.149646227Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-keepalived:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-keepalived:current-tripleo" May 2 07:48:59 localhost dockerd-current: time="2018-05-02T07:48:59.150724148Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-keepalived:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-keepalived:current-tripleo not found" May 2 07:48:59 localhost dockerd-current: time="2018-05-02T07:48:59.151694423Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-keepalived:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-keepalived:current-tripleo: no such volume" May 2 07:48:59 localhost dockerd-current: time="2018-05-02T07:48:59.174090352Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-keepalived:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-keepalived:current-tripleo\" not found" May 2 07:49:25 localhost dockerd-current: time="2018-05-02T07:49:25.059574341Z" level=error msg="containerd: deleting container" error="exit status 1: \"container 42098c2ce62443302d207c565e85f8ab78472631844d4119e67c9d201f305c46 does not exist\none or more of the container deletions failed\n\"" May 2 07:49:25 localhost dockerd-current: time="2018-05-02T07:49:25.156108990Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-iscsid returned error: No such container: docker-puppet-iscsid" May 2 07:49:25 localhost dockerd-current: time="2018-05-02T07:49:25.183047818Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-iscsid:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-iscsid:current-tripleo" May 2 07:49:25 localhost dockerd-current: time="2018-05-02T07:49:25.183978007Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-iscsid:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-iscsid:current-tripleo" May 2 07:49:25 localhost dockerd-current: time="2018-05-02T07:49:25.185330233Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-iscsid:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-iscsid:current-tripleo not found" May 2 07:49:25 localhost dockerd-current: time="2018-05-02T07:49:25.186271552Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-iscsid:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-iscsid:current-tripleo: no such volume" May 2 07:49:25 localhost dockerd-current: time="2018-05-02T07:49:25.219086371Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-iscsid:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-iscsid:current-tripleo\" not found" May 2 07:49:26 localhost dockerd-current: time="2018-05-02T07:49:26.251790525Z" level=error msg="containerd: deleting container" error="exit status 1: \"container b90e7ddebf2e6d55c51626937d82172cab666a942653a4195e4e55c9daa43e79 does not exist\none or more of the container deletions failed\n\"" May 2 07:49:26 localhost dockerd-current: time="2018-05-02T07:49:26.330742910Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-memcached returned erro: No such container: docker-puppet-memcached" May 2 07:49:26 localhost dockerd-current: time="2018-05-02T07:49:26.357352778Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-memcached:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-memcached:current-tripleo" May 2 07:49:26 localhost dockerd-current: time="2018-05-02T07:49:26.358199642Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-memcached:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-memcached:current-tripleo" May 2 07:49:26 localhost dockerd-current: time="2018-05-02T07:49:26.359186669Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-memcached:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-memcached:current-tripleo not found" May 2 07:49:26 localhost dockerd-current: time="2018-05-02T07:49:26.360090253Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-memcached:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-memcached:current-tripleo: no such volume" May 2 07:49:26 localhost dockerd-current: time="2018-05-02T07:49:26.386830115Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-memcached:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-memcached:current-tripleo\" not found" May 2 07:49:49 localhost dockerd-current: time="2018-05-02T07:49:49.580700643Z" level=error msg="containerd: deleting container" error="exit status 1: \"container de929214a15f37221fdad8b4f43eda1279f986e3d8205469b47a72bbd029044f does not exist\none or more of the container deletions failed\n\"" May 2 07:49:49 localhost dockerd-current: time="2018-05-02T07:49:49.651103547Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-heat returned error: No such container: docker-puppet-heat" May 2 07:49:49 localhost dockerd-current: time="2018-05-02T07:49:49.675694960Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-heat-api:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-heat-api:current-tripleo" May 2 07:50:03 localhost dockerd-current: time="2018-05-02T07:50:03.80252104Z" level=error msg="containerd: deleting container" error="exit status 1: \"container 0b1c714de88a752a01b70cca82032a0fccd0c4d218ed6f4ca4de09275f57bc61 does not exist\none or more of the container deletions failed\n\"" May 2 07:50:03 localhost dockerd-current: time="2018-05-02T07:50:03.870980413Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-cinder returned error: No such container: docker-puppet-cinder" May 2 07:50:03 localhost dockerd-current: time="2018-05-02T07:50:03.894674223Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-cinder-api:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-cinder-api:current-tripleo" May 2 07:50:03 localhost dockerd-current: time="2018-05-02T07:50:03.895607548Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-cinder-api:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-cinder-api:current-tripleo" May 2 07:50:03 localhost dockerd-current: time="2018-05-02T07:50:03.896561396Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-cinder-api:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-cinder-api:current-tripleo not found" May 2 07:50:03 localhost dockerd-current: time="2018-05-02T07:50:03.897835725Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-cinder-api:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-cinder-api:current-tripleo: no such volume" May 2 07:50:03 localhost dockerd-current: time="2018-05-02T07:50:03.923921529Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-cinder-api:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-cinder-api:current-tripleo\" not found" May 2 07:50:11 localhost dockerd-current: time="2018-05-02T07:50:11.118377221Z" level=error msg="containerd: deleting container" error="exit status 1: \"container d6f9946a360be51c60cc638147c7b76c2750ac89c2ae8822c0a77a1a003e930e does not exist\none or more of the container deletions failed\n\"" May 2 07:50:11 localhost dockerd-current: time="2018-05-02T07:50:11.341675229Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-keystone returned error: No such container: docker-puppet-keystone" May 2 07:50:11 localhost dockerd-current: time="2018-05-02T07:50:11.370783397Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-keystone:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-keystone:current-tripleo" May 2 07:50:11 localhost dockerd-current: time="2018-05-02T07:50:11.371807747Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-keystone:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-keystone:current-tripleo" May 2 07:50:11 localhost dockerd-current: time="2018-05-02T07:50:11.373074124Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-keystone:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-keystone:current-tripleo not found" May 2 07:50:11 localhost dockerd-current: time="2018-05-02T07:50:11.376201592Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-keystone:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-keystone:current-tripleo: no such volume" May 2 07:50:11 localhost dockerd-current: time="2018-05-02T07:50:11.409174635Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-keystone:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-keystone:current-tripleo\" not found" May 2 07:50:20 localhost dockerd-current: time="2018-05-02T07:50:20.020944883Z" level=error msg="containerd: deleting container" error="exit status 1: \"container c0606585ee394f3cc667b2b0d43bbf62207b437dce8690437a9b26c0c633e447 does not exist\none or more of the container deletions failed\n\"" May 2 07:50:20 localhost dockerd-current: time="2018-05-02T07:50:20.092132607Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-panko returned error: No such container: docker-puppet-panko" May 2 07:50:20 localhost dockerd-current: time="2018-05-02T07:50:20.118639159Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-panko-api:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-panko-api:current-tripleo" May 2 07:50:20 localhost dockerd-current: time="2018-05-02T07:50:20.119629432Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-panko-api:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-panko-api:current-tripleo" May 2 07:50:20 localhost dockerd-current: time="2018-05-02T07:50:20.120576980Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-panko-api:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-panko-api:current-tripleo not found" May 2 07:50:20 localhost dockerd-current: time="2018-05-02T07:50:20.121487269Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-panko-api:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-panko-api:current-tripleo: no such volume" May 2 07:50:20 localhost dockerd-current: time="2018-05-02T07:50:20.149382832Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-panko-api:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-panko-api:current-tripleo\" not found" May 2 07:51:06 localhost dockerd-current: time="2018-05-02T07:51:06.386260272Z" level=error msg="containerd: deleting container" error="exit status 1: \"container 6b3acea5b8cce51a1f413796607a15201b9192767a252e35cfe5e0e64865d31f does not exist\none or more of the container deletions failed\n\"" May 2 07:51:06 localhost dockerd-current: time="2018-05-02T07:51:06.474078441Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-swift returned error: No such container: docker-puppet-swift" May 2 07:51:06 localhost dockerd-current: time="2018-05-02T07:51:06.497907457Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-swift-proxy-server:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-swift-proxy-server:current-tripleo" May 2 07:51:19 localhost puppet-user[13]: (/Stage[main]/Swift::Proxy/Swift_proxy_config[pipeline:main/pipeline]/value) value changed 'catch_errors gatekeeper healthcheck proxy-logging cache container_sync bulk tempurl ratelimit copy container-quotas account-quotas slo dlo versioned_writes proxy-logging proxy-server' to 'catch_errors healthcheck proxy-logging cache ratelimit bulk tempurl formpost authtoken keystone staticweb copy container_quotas account_quotas slo dlo versioned_writes proxy-logging proxy-server' May 2 07:51:19 localhost journal: Notice: /Stage[main]/Swift::Proxy/Swift_proxy_config[pipeline:main/pipeline]/value: value changed 'catch_errors gatekeeper healthcheck proxy-logging cache container_sync bulk tempurl ratelimit copy container-quotas account-quotas slo dlo versioned_writes proxy-logging proxy-server' to 'catch_errors healthcheck proxy-logging cache ratelimit bulk tempurl formpost authtoken keystone staticweb copy container_quotas account_quotas slo dlo versioned_writes proxy-logging proxy-server' May 2 07:51:22 localhost dockerd-current: time="2018-05-02T07:51:22.655070683Z" level=error msg="containerd: deleting container" error="exit status 1: \"container 34f1b681e4aefb76494054588a1d45158d77a0d52d97c4782045826a97ef7b08 does not exist\none or more of the container deletions failed\n\"" May 2 07:51:22 localhost dockerd-current: time="2018-05-02T07:51:22.748691976Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-crond returned error: No such container: docker-puppet-crond" May 2 07:51:22 localhost dockerd-current: time="2018-05-02T07:51:22.781874479Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-cron:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-cron:current-tripleo" May 2 07:51:22 localhost dockerd-current: time="2018-05-02T07:51:22.782980085Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-cron:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-cron:current-tripleo" May 2 07:51:22 localhost dockerd-current: time="2018-05-02T07:51:22.784112476Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-cron:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-cron:current-tripleo not found" May 2 07:51:22 localhost dockerd-current: time="2018-05-02T07:51:22.785167986Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-cron:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-cron:current-tripleo: no such volume" May 2 07:51:22 localhost dockerd-current: time="2018-05-02T07:51:22.816557879Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-cron:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-cron:current-tripleo\" not found" May 2 07:51:28 localhost dockerd-current: time="2018-05-02T07:51:28.819552085Z" level=error msg="containerd: deleting container" error="exit status 1: \"container 0ceec3b35d56fe193c066bb6d6d9ae52120450877b14236c9dafbda3a4afb634 does not exist\none or more of the container deletions failed\n\"" May 2 07:51:28 localhost dockerd-current: time="2018-05-02T07:51:28.926881496Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-haproxy returned error: No such container: docker-puppet-haproxy" May 2 07:51:28 localhost dockerd-current: time="2018-05-02T07:51:28.954911764Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-haproxy:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-haproxy:current-tripleo" May 2 07:51:28 localhost dockerd-current: time="2018-05-02T07:51:28.955933211Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-haproxy:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-haproxy:current-tripleo" May 2 07:51:28 localhost dockerd-current: time="2018-05-02T07:51:28.962827215Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-haproxy:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-haproxy:current-tripleo not found" May 2 07:51:28 localhost dockerd-current: time="2018-05-02T07:51:28.967255711Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-haproxy:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-haproxy:current-tripleo: no such volume" May 2 07:51:29 localhost dockerd-current: time="2018-05-02T07:51:29.004800019Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-haproxy:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-haproxy:current-tripleo\" not found" May 2 07:51:38 localhost dockerd-current: time="2018-05-02T07:51:38.008165785Z" level=error msg="containerd: deleting container" error="exit status 1: \"container c3891bcdef88be4631ce9220973b686cda68e40107a0014a887b76aecb133f52 does not exist\none or more of the container deletions failed\n\"" May 2 07:51:38 localhost dockerd-current: time="2018-05-02T07:51:38.076688182Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-rabbitmq returned error: No such container: docker-puppet-rabbitmq" May 2 07:51:38 localhost dockerd-current: time="2018-05-02T07:51:38.103065259Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-rabbitmq:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-rabbitmq:current-tripleo" May 2 07:51:38 localhost dockerd-current: time="2018-05-02T07:51:38.104066501Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-rabbitmq:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-rabbitmq:current-tripleo" May 2 07:51:38 localhost dockerd-current: time="2018-05-02T07:51:38.105371666Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-rabbitmq:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-rabbitmq:current-tripleo not found" May 2 07:51:38 localhost dockerd-current: time="2018-05-02T07:51:38.106473919Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-rabbitmq:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-rabbitmq:current-tripleo: no such volume" May 2 07:51:38 localhost dockerd-current: time="2018-05-02T07:51:38.142415550Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-rabbitmq:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-rabbitmq:current-tripleo\" not found" May 2 07:51:52 localhost dockerd-current: time="2018-05-02T07:51:52.83299969Z" level=error msg="containerd: deleting container" error="exit status 1: \"container e8d76a64d01e9a11e6c0a460ab2ff126c0f9b973f9af967cd3e8db2446ae6a5e does not exist\none or more of the container deletions failed\n\"" May 2 07:51:52 localhost dockerd-current: time="2018-05-02T07:51:52.924385939Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-horizon returned error: No such container: docker-puppet-horizon" May 2 07:51:52 localhost dockerd-current: time="2018-05-02T07:51:52.954142151Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-horizon:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-horizon:current-tripleo" May 2 07:51:52 localhost dockerd-current: time="2018-05-02T07:51:52.955098490Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-horizon:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-horizon:current-tripleo" May 2 07:51:52 localhost dockerd-current: time="2018-05-02T07:51:52.956217820Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-horizon:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-horizon:current-tripleo not found" May 2 07:51:52 localhost dockerd-current: time="2018-05-02T07:51:52.957178646Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-horizon:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-horizon:current-tripleo: no such volume" May 2 07:51:52 localhost dockerd-current: time="2018-05-02T07:51:52.997204251Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-horizon:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-horizon:current-tripleo\" not found" May 2 07:52:08 localhost dockerd-current: time="2018-05-02T07:52:08.907489818Z" level=error msg="containerd: deleting container" error="exit status 1: \"container 3bcdd3dcce13905030c683ccd9a1bc47cb3fb036cb68f832e11bb3fdbb1a5b65 does not exist\none or more of the container deletions failed\n\"" May 2 07:52:08 localhost dockerd-current: time="2018-05-02T07:52:08.982907057Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-ceilometer returned error: No such container: docker-puppet-ceilometer" May 2 07:52:09 localhost dockerd-current: time="2018-05-02T07:52:09.008538818Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-ceilometer-central:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-ceilometer-central:current-tripleo" May 2 07:52:09 localhost dockerd-current: time="2018-05-02T07:52:09.009585589Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-ceilometer-central:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-ceilometer-central:current-tripleo" May 2 07:52:09 localhost dockerd-current: time="2018-05-02T07:52:09.010841497Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-ceilometer-central:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-ceilometer-central:current-tripleo not found" May 2 07:52:09 localhost dockerd-current: time="2018-05-02T07:52:09.011649743Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-ceilometer-central:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-ceilometer-central:current-tripleo: no such volume" May 2 07:52:09 localhost dockerd-current: time="2018-05-02T07:52:09.045637873Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-ceilometer-central:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-ceilometer-central:current-tripleo\" not found" May 2 07:52:51 localhost puppet-user[12]: (/Stage[main]/Ceilometer::Agent::Notification/Ceilometer_config[notification/ack_on_event_error]/ensure) created May 2 07:52:51 localhost journal: Notice: /Stage[main]/Ceilometer::Agent::Notification/Ceilometer_config[notification/ack_on_event_error]/ensure: created May 2 07:52:54 localhost dockerd-current: time="2018-05-02T07:52:54.577884661Z" level=error msg="containerd: deleting container" error="exit status 1: \"container 8649889b90d9e425bf6f9cd880291967ed1b86db4c9e343c4ceacf56de6dcc46 does not exist\none or more of the container deletions failed\n\"" May 2 07:53:02 localhost puppet-user[12]: Evaluation Error: Error while evaluating a Function Call, Could not find data item rabbitmq_short_bootstrap_node_name in any Hiera data file and no default supplied at /etc/puppet/modules/tripleo/manifests/profile/base/rabbitmq.pp:96:36 on node controller-0.localdomain May 2 07:53:02 localhost journal: Error: Evaluation Error: Error while evaluating a Function Call, Could not find data item rabbitmq_short_bootstrap_node_name in any Hiera data file and no default supplied at /etc/puppet/modules/tripleo/manifests/profile/base/rabbitmq.pp:96:36 on node controller-0.localdomain May 2 07:53:03 localhost dockerd-current: time="2018-05-02T07:53:03.007971179Z" level=error msg="containerd: deleting container" error="exit status 1: \"container 1431aabc2ba76a0477239cff8ae4770a04d246a3553e28719cdb1cda3b95c34b does not exist\none or more of the container deletions failed\n\"" May 2 07:53:03 localhost dockerd-current: time="2018-05-02T07:53:03.042862929Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-neutron returned error: No such container: docker-puppet-neutron" May 2 07:53:03 localhost dockerd-current: time="2018-05-02T07:53:03.074549237Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-neutron-server:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-neutron-server:current-tripleo" May 2 07:53:03 localhost dockerd-current: time="2018-05-02T07:53:03.075564909Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-neutron-server:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-neutron-server:current-tripleo" May 2 07:53:03 localhost dockerd-current: time="2018-05-02T07:53:03.076483444Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-neutron-server:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-neutron-server:current-tripleo not found" May 2 07:53:03 localhost dockerd-current: time="2018-05-02T07:53:03.077190841Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-neutron-server:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-neutron-server:current-tripleo: no such volume" May 2 07:53:03 localhost dockerd-current: time="2018-05-02T07:53:03.114982044Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-neutron-server:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-neutron-server:current-tripleo\" not found" May 2 07:53:29 localhost dockerd-current: time="2018-05-02T07:53:29.634641191Z" level=error msg="containerd: deleting container" error="exit status 1: \"container 941098542a2762685f1cd0b6f494f21273632ea7edeea03edb07f63e4aefa137 does not exist\none or more of the container deletions failed\n\"" May 2 07:53:29 localhost dockerd-current: time="2018-05-02T07:53:29.733824781Z" level=error msg="Handler for DELETE /v1.26/containers/docker-puppet-heat_api_cfn returned error: No such container: docker-puppet-heat_api_cfn" May 2 07:53:29 localhost dockerd-current: time="2018-05-02T07:53:29.766581912Z" level=error msg="Handler for GET /v1.26/containers/docker.io/tripleomaster/centos-binary-heat-api-cfn:current-tripleo/json returned error: No such container: docker.io/tripleomaster/centos-binary-heat-api-cfn:current-tripleo" May 2 07:53:29 localhost dockerd-current: time="2018-05-02T07:53:29.767585995Z" level=error msg="Handler for GET /v1.26/images/docker.io/tripleomaster/centos-binary-heat-api-cfn:current-tripleo/json returned error: No such image: docker.io/tripleomaster/centos-binary-heat-api-cfn:current-tripleo" May 2 07:53:29 localhost dockerd-current: time="2018-05-02T07:53:29.768609749Z" level=error msg="Handler for GET /v1.26/networks/docker.io/tripleomaster/centos-binary-heat-api-cfn:current-tripleo returned error: network docker.io/tripleomaster/centos-binary-heat-api-cfn:current-tripleo not found" May 2 07:53:29 localhost dockerd-current: time="2018-05-02T07:53:29.769653914Z" level=error msg="Handler for GET /v1.26/volumes/docker.io/tripleomaster/centos-binary-heat-api-cfn:current-tripleo returned error: get docker.io/tripleomaster/centos-binary-heat-api-cfn:current-tripleo: no such volume" May 2 07:53:29 localhost dockerd-current: time="2018-05-02T07:53:29.806553887Z" level=error msg="Handler for GET /v1.26/plugins/docker.io/tripleomaster/centos-binary-heat-api-cfn:current-tripleo/json returned error: plugin \"docker.io/tripleomaster/centos-binary-heat-api-cfn:current-tripleo\" not found" May 2 07:53:48 localhost dockerd-current: time="2018-05-02T07:53:48.08527318Z" level=error msg="containerd: deleting container" error="exit status 1: \"container bb1e2371c70f7555b0b78abe3281e77fec74873bc822483d160e39747e97dc31 does not exist\none or more of the container deletions failed\n\"" May 2 07:53:54 localhost dockerd-current: time="2018-05-02T07:53:54.633969186Z" level=error msg="containerd: deleting container" error="exit status 1: \"container 958251300dfae17c0984a5055a22a66e71ebeb854eeb7c77cd7c0c58da4c2b7e does not exist\none or more of the container deletions failed\n\"" [root@controller-0 ~]# [root@controller-0 ~]# docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES [root@controller-0 ~]# [root@controller-0 ~]# docker images REPOSITORY TAG IMAGE ID CREATED SIZE docker.io/tripleomaster/centos-binary-gnocchi-api current-tripleo 4a45eede40dd 19 hours ago 1.09 GB docker.io/tripleomaster/centos-binary-cinder-api current-tripleo 31302a7a8bf7 19 hours ago 1.11 GB docker.io/tripleomaster/centos-binary-panko-api current-tripleo f6973acd8107 19 hours ago 862 MB docker.io/tripleomaster/centos-binary-swift-proxy-server current-tripleo 6d883f0198a6 19 hours ago 861 MB docker.io/tripleomaster/centos-binary-horizon current-tripleo a0b6e3ae6e09 19 hours ago 1.04 GB docker.io/tripleomaster/centos-binary-heat-api current-tripleo 567b0ecc28ed 19 hours ago 855 MB docker.io/tripleomaster/centos-binary-neutron-server current-tripleo 31c466724e01 19 hours ago 954 MB docker.io/tripleomaster/centos-binary-heat-api-cfn current-tripleo c82b55108222 19 hours ago 855 MB docker.io/tripleomaster/centos-binary-nova-placement-api current-tripleo 07de9a9a9d36 19 hours ago 1.02 GB docker.io/tripleomaster/centos-binary-glance-api current-tripleo 1163c55dc878 19 hours ago 1.01 GB docker.io/tripleomaster/centos-binary-nova-api current-tripleo 8cfbfe35c025 19 hours ago 1.02 GB docker.io/tripleomaster/centos-binary-aodh-api current-tripleo f323df9228ff 19 hours ago 850 MB docker.io/tripleomaster/centos-binary-ceilometer-central current-tripleo b858bfa84685 19 hours ago 855 MB docker.io/tripleomaster/centos-binary-keystone current-tripleo f4e59bf6c9a0 19 hours ago 827 MB docker.io/tripleomaster/centos-binary-mariadb current-tripleo 3bb552f86896 19 hours ago 841 MB docker.io/tripleomaster/centos-binary-rabbitmq current-tripleo 1722882c0916 19 hours ago 725 MB docker.io/tripleomaster/centos-binary-redis current-tripleo 15c5d9f17989 19 hours ago 684 MB docker.io/tripleomaster/centos-binary-haproxy current-tripleo 39a8ba25ee3d 19 hours ago 710 MB docker.io/tripleomaster/centos-binary-keepalived current-tripleo 658ebc45d351 19 hours ago 601 MB docker.io/tripleomaster/centos-binary-memcached current-tripleo 1b12d1289365 19 hours ago 595 MB docker.io/tripleomaster/centos-binary-iscsid current-tripleo 662c35cd0b32 19 hours ago 562 MB docker.io/tripleomaster/centos-binary-cron current-tripleo 3facce5e9730 19 hours ago 557 MB [root@controller-0 ~]# [root@controller-0 ~]# docker ps -a CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 1431aabc2ba7 docker.io/tripleomaster/centos-binary-rabbitmq:current-tripleo "/var/lib/docker-p..." 13 minutes ago Exited (1) 13 minutes ago docker-puppet-rabbitmq [root@controller-0 ~]# [root@controller-0 ~]#

Command used for deployment:

infrared tripleo-overcloud --version queens --deployment-files virt --introspect yes --tagging yes --deploy yes --containers yes --libvirt-type qemu --registry-mirror trunk.registry.rdoproject.org --registry-namespace master --registry-tag current-tripleo-rdo --registry-prefix=centos-binary- --registry-skip-puddle yes --post yes

obaranov commented 6 years ago

@Kosal-Raj,

I thing you need to provide additional templates with the --overcloud-templates option. At minimum you need docker-queens_image. Check my command snippet that works:

infrared tripleo-overcloud \ .... --overcloud-templates sahara,disable-telemetry,ceph-min-osds,docker-queens_image \ .... --containers yes \ --registry-mirror trunk.registry.rdoproject.org \ --registry-namespace master \ --registry-tag current-tripleo-rdo \ --registry-prefix='centos-binary-' \ --registry-skip-puddle yes

Kosal-Raj commented 6 years ago

@obaranov Thanks a lot for owning the issue and for the quick response. I will try testing again with the provided option.

Kosal-Raj commented 6 years ago

@obaranov I have tried redeploying by providing the options provided but still no luck. I am getting the same error.

Command used for deployment: infrared tripleo-overcloud --version queens --deployment-files virt --introspect yes --tagging yes --deploy yes --overcloud-templates docker-queens_image --containers yes --libvirt-type qemu --registry-mirror trunk.registry.rdoproject.org --registry-namespace master --registry-tag current-tripleo-rdo --registry-prefix=centos-binary- --registry-skip-puddle yes --post yes

obaranov commented 6 years ago

@Kosal-Raj, strange... Can you please attach the complete Infrared log. Can you also try to add disable-telemetry to the --overcloud-templates?

Kosal-Raj commented 6 years ago

deployment.txt

@obaranov Still no luck... I have attached the infrared log for your reference.

obaranov commented 6 years ago

@Kosal-Raj, Re deployment log. I see that you do not provide the --build argument when you deploy undercloud. This means that you will use the latest possible queens build (which can be not stable). I suggest to provide a build for the undercloud commands. I use the following commands:

infrared tripleo-undercloud -o install.yml -o undercloud-install.yml --version queens --build current-tripleo-rdo --ssl yes

and for images:

infrared tripleo-undercloud -o undercloud-images.yml --images-task import --images-url http://<images_host>/current-tripleo-rdo --images-update yes --build current-tripleo-rdo --mirror tlv

AlexCallejas commented 4 years ago

Hi @obaranov ,

I have followed your recommendations, but I stay stuck in the same place: TASK [containers/prepare-templates : openstack overcloud container image upload] ************************************************************************************************ fatal: [undercloud-0]: FAILED! => {"changed": true, "cmd": "source /home/stack/stackrc\n openstack overcloud container image upload --verbose --config-file /home/stack/container_images.yaml", "delta": "0:00:46.646731", "end": "2019-11-11 17:58:34.373993", "msg": "non-zero return code", "rc": 1, "start": "2019-11-11 17:57:47.727262", "stderr": "START with options: [u'overcloud', u'container', u'image', u'upload', u'--verbose', u'--config-file', u'/home/stack/container_images.yaml']\ncommand: overcloud container image upload -> tripleoclient.v1.container_image.UploadImage (auth=False)\nUsing config files: [u'/home/stack/container_images.yaml']\nimagename: trunk.registry.rdoproject.org/tripleo/centos-binary-swift-proxy-server:tripleo-current\nRunning skopeo inspect docker://trunk.registry.rdoproject.org/tripleo/centos-binary-swift-proxy-server:tripleo-current\nRunning skopeo inspect docker://trunk.registry.rdoproject.org/tripleo/centos-binary-swift-proxy-server:tripleo-current\nRunning skopeo inspect docker://trunk.registry.rdoproject.org/tripleo/centos-binary-swift-proxy-server:tripleo-current\nRunning skopeo inspect docker://trunk.registry.rdoproject.org/tripleo/centos-binary-swift-proxy-server:tripleo-current\nRunning skopeo inspect docker://trunk.registry.rdoproject.org/tripleo/centos-binary-swift-proxy-server:tripleo-current\ndocker pull failed: Error: image tripleo/centos-binary-swift-proxy-server:tripleo-current not found\ndocker pull failed: Error: image tripleo/centos-binary-swift-proxy-server:tripleo-current not found\ndocker pull failed: Error: image tripleo/centos-binary-swift-proxy-server:tripleo-current not found\ndocker pull failed: Error: image tripleo/centos-binary-swift-proxy-server:tripleo-current not found\ndocker pull failed: Error: image tripleo/centos-binary-swift-proxy-server:tripleo-current not found\nCould not pull image trunk.registry.rdoproject.org/tripleo/centos-binary-swift-proxy-server\nEND return value: 1", "stderr_lines": ["START with options: [u'overcloud', u'container', u'image', u'upload', u'--verbose', u'--config-file', u'/home/stack/container_images.yaml']", "command: overcloud container image upload -> tripleoclient.v1.container_image.UploadImage (auth=False)", "Using config files: [u'/home/stack/container_images.yaml']", "imagename: trunk.registry.rdoproject.org/tripleo/centos-binary-swift-proxy-server:tripleo-current", "Running skopeo inspect docker://trunk.registry.rdoproject.org/tripleo/centos-binary-swift-proxy-server:tripleo-current", "Running skopeo inspect docker://trunk.registry.rdoproject.org/tripleo/centos-binary-swift-proxy-server:tripleo-current", "Running skopeo inspect docker://trunk.registry.rdoproject.org/tripleo/centos-binary-swift-proxy-server:tripleo-current", "Running skopeo inspect docker://trunk.registry.rdoproject.org/tripleo/centos-binary-swift-proxy-server:tripleo-current", "Running skopeo inspect docker://trunk.registry.rdoproject.org/tripleo/centos-binary-swift-proxy-server:tripleo-current", "docker pull failed: Error: image tripleo/centos-binary-swift-proxy-server:tripleo-current not found", "docker pull failed: Error: image tripleo/centos-binary-swift-proxy-server:tripleo-current not found", "docker pull failed: Error: image tripleo/centos-binary-swift-proxy-server:tripleo-current not found", "docker pull failed: Error: image tripleo/centos-binary-swift-proxy-server:tripleo-current not found", "docker pull failed: Error: image tripleo/centos-binary-swift-proxy-server:tripleo-current not found", "Could not pull image trunk.registry.rdoproject.org/tripleo/centos-binary-swift-proxy-server", "END return value: 1"], "stdout": "", "stdout_lines": []}

When I run it manually, it sends me: (undercloud) [stack@undercloud-0 ~]$ skopeo inspect docker://trunk.registry.rdoproject.org/tripleo/centos-binary-swift-proxy-server:tripleo-current

FATA[0000] Error reading manifest tripleo-current in trunk.registry.rdoproject.org/tripleo/centos-binary-swift-proxy-server: unauthorized: authentication required

I Review the documentation at: https://rdo-container-registry.readthedocs.io/en/latest/using.html

but https://console.registry.rdoproject.org/ sends me: An authentication error occurred.

Thanks in advance,