invalid tag format, TASK [kolla ansible deploy]

penaivanalejandro commented 6 years ago

Error when created the format TASK [kolla ansible deploy]

nAPIError: 500 Server Error: Internal Server Error (\\"invalid tag format\\")

fatal: [10.197.121.25]: FAILED! => {"changed": true, "cmd": ["kolla-ansible", "deploy", "-i", "/etc/kolla_packages/source/inventory/multinode"], "delta": "0:00:20.585155", "end": "2018-01-26 12:57:28.366969", "failed": true, "rc": 1, "start": "2018-01-26 12:57:07.781814", "stderr": "", "stdout": "Deploying Playbooks : ansible-playbook -i /etc/kolla_packages/source/inventory/multinode -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla -e action=deploy /usr/local/share/kolla-ansible/ansible/site.yml \n\nPLAY [Gather facts for all hosts] **\n\nTASK [setup] *****\nok: [localhost]\nok: [10.197.121.25]\nok: [10.197.121.26]\n\nPLAY [Gather facts for all hosts (if using --limit)] *\n\nTASK [setup] *****\nskipping: [10.197.121.25] => (item=10.197.121.25) \nskipping: [localhost] => (item=10.197.121.25) \nskipping: [localhost] => (item=localhost) \nskipping: [localhost] => (item=10.197.121.26) \nskipping: [10.197.121.26] => (item=localhost) \nskipping: [10.197.121.26] => (item=10.197.121.26) \nskipping: [10.197.121.26] => (item=10.197.121.25) \nskipping: [10.197.121.25] => (item=localhost) \nskipping: [10.197.121.25] => (item=10.197.121.26) \n\nPLAY [Detect openstack_release variable] *\n\nTASK [Get current kolla-ansible version number] ****\nskipping: [10.197.121.25]\nskipping: [10.197.121.26]\nskipping: [localhost]\n\nTASK [Set openstack_release variable] **\nskipping: [10.197.121.25]\nskipping: [10.197.121.26]\nskipping: [localhost]\n\nPLAY [Apply role prechecks] ****\n\nTASK [prechecks : Checking the api_interface is present] ***\nskipping: [10.197.121.25]\nskipping: [10.197.121.26]\nskipping: [localhost]\n\nTASK [prechecks : Checking the api_interface is active] ****\nskipping: [10.197.121.25]\nskipping: [10.197.121.26]\nskipping: [localhost]\n\nTASK [prechecks : Checking the api_interface configuration] ****\nskipping: [10.197.121.25]\nskipping: [10.197.121.26]\nskipping: [localhost]\n\nTASK [prechecks : Checking the api_interface ip address configuration] *\nskipping: [10.197.121.25]\nskipping: [10.197.121.26]\nskipping: [localhost]\n\nTASK [prechecks : Checking Docker version] ***\nskipping: [10.197.121.25]\nskipping: [10.197.121.26]\nskipping: [localhost]\n\nTASK [prechecks : Checking empty passwords in passwords.yml. Run kolla-genpwd if this task fails] *\nskipping: [10.197.121.25]\n\nTASK [prechecks : Checking docker SDK version] *\nskipping: [10.197.121.25]\nskipping: [10.197.121.26]\nskipping: [localhost]\n\nTASK [prechecks : Checking Ansible version] ****\nskipping: [10.197.121.25]\n\nPLAY [Apply role chrony] ***\n\nTASK [common : include] ****\nskipping: [10.197.121.25]\nskipping: [10.197.121.26]\n\nTASK [common : Registering common role has run] ****\nskipping: [10.197.121.25]\nskipping: [10.197.121.26]\n\nTASK [chrony : include] ****\nskipping: [10.197.121.25]\nskipping: [10.197.121.26]\n\nPLAY [Apply role collectd] *\n\nTASK [common : include] ****\nskipping: [10.197.121.26]\n\nTASK [common : Registering common role has run] ****\nskipping: [10.197.121.26]\n\nTASK [collectd : include] **\nskipping: [10.197.121.26]\n\nPLAY [Apply role elasticsearch] ****\n\nTASK [common : include] ****\nskipping: [10.197.121.25]\n\nTASK [common : Registering common role has run] ****\nskipping: [10.197.121.25]\n\nTASK [elasticsearch : include] *\nskipping: [10.197.121.25]\n\nPLAY [Apply role telegraf] ***\n\nTASK [common : include] ****\nskipping: [10.197.121.26]\nskipping: [10.197.121.25]\n\nTASK [common : Registering common role has run] ****\nskipping: [10.197.121.26]\nskipping: [10.197.121.25]\n\nTASK [telegraf : include] **\nskipping: [10.197.121.26]\nskipping: [10.197.121.25]\n\nPLAY [Apply role redis] ****\n\nTASK [common : include] ****\nincluded: /usr/local/share/kolla-ansible/ansible/roles/common/tasks/deploy.yml for 10.197.121.25\n\nTASK [common : include] ****\nincluded: /usr/local/share/kolla-ansible/ansible/roles/common/tasks/config.yml for 10.197.121.25\n\nTASK [common : Ensuring config directories exist] **\nchanged: [10.197.121.25] => (item=fluentd)\nchanged: [10.197.121.25] => (item=fluentd/input)\nchanged: [10.197.121.25] => (item=fluentd/output)\nchanged: [10.197.121.25] => (item=fluentd/format)\nchanged: [10.197.121.25] => (item=fluentd/filter)\nchanged: [10.197.121.25] => (item=kolla-toolbox)\nchanged: [10.197.121.25] => (item=cron)\nchanged: [10.197.121.25] => (item=cron/logrotate)\n\nTASK [common : Copying over config.json files for services] ****\nchanged: [10.197.121.25] => (item={'key': u'cron', 'value': {u'environment': {u'DUMMY_ENVIRONMENT': u'kolla_useless_env'}, u'image': u'10.197.121.25:4000/kolla/ubuntu-source-cron:5.0.2 ', u'volumes': [u'/etc/kolla//cron/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'kolla_logs:/var/log/kolla/'], u'container_name': u'cron'}})\nchanged: [10.197.121.25] => (item={'key': u'fluentd', 'value': {u'environment': {u'KOLLA_CONFIG_STRATEGY': u'COPY_ALWAYS'}, u'image': u'10.197.121.25:4000/kolla/ubuntu-source-fluentd:5.0.2 ', u'volumes': [u'/etc/kolla//fluentd/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'kolla_logs:/var/log/kolla/'], u'container_name': u'fluentd'}})\nchanged: [10.197.121.25] => (item={'key': u'kolla-toolbox', 'value': {u'environment': {u'ANSIBLE_LIBRARY': u'/usr/share/ansible', u'ANSIBLE_NOCOLOR': u'1'}, u'image': u'10.197.121.25:4000/kolla/ubuntu-source-kolla-toolbox:5.0.2 ', u'privileged': True, u'volumes': [u'/etc/kolla//kolla-toolbox/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'/dev/:/dev/', u'/run/:/run/:shared', u'kolla_logs:/var/log/kolla/'], u'container_name': u'kolla_toolbox'}})\n\nTASK [common : Copying over fluentd input config files] ****\nchanged: [10.197.121.25] => (item=00-global)\nchanged: [10.197.121.25] => (item=01-syslog)\nchanged: [10.197.121.25] => (item=02-mariadb)\nchanged: [10.197.121.25] => (item=03-rabbitmq)\nchanged: [10.197.121.25] => (item=04-openstack-wsgi)\n\nTASK [common : Copying over fluentd output config files] *\nchanged: [10.197.121.25] => (item={u'enabled': True, u'name': u'00-local'})\nskipping: [10.197.121.25] => (item={u'enabled': False, u'name': u'01-es'}) \n\nTASK [common : Copying over fluentd format config files] \nchanged: [10.197.121.25] => (item=apache_access)\nchanged: [10.197.121.25] => (item=wsgi_access)\n\nTASK [common : Copying over fluentd filter config files] \nchanged: [10.197.121.25] => (item={u'dest': u'00-record_transformer', u'src': u'00-record_transformer'})\nchanged: [10.197.121.25] => (item={u'dest': u'01-rewrite', u'src': u'01-rewrite-0.14'})\n\nTASK [common : Copying over td-agent.conf] ***\nchanged: [10.197.121.25] => (item=fluentd)\n\nTASK [common : Copying over cron logrotate config files] *\nchanged: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'ansible'})\nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'aodh'}) \nchanged: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'barbican'})\nchanged: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'ceilometer'})\nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'ceph'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'chrony'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'cinder'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'cloudkitty'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'collectd'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'congress'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'designate'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'elasticsearch'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'etcd'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'freezer'}) \nchanged: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'glance'})\nchanged: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'global'})\nchanged: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'gnocchi'})\nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'grafana'}) \nchanged: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'haproxy'})\nchanged: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'heat'})\nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'influxdb'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'ironic'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'ironic-inspector'}) \nskipping: [10.197.121.25] => (item={u'enabled': False, u'name': u'iscsid'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'karbor'}) \nchanged: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'keepalived'})\nchanged: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'keystone'})\nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'kibana'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'kuryr'}) \nchanged: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'magnum'})\nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'manila'}) \nchanged: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'mariadb'})\nchanged: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'mistral'})\nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'mongodb'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'murano'}) \nchanged: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'neutron'})\nchanged: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'nova'})\nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'octavia'}) \nskipping: [10.197.121.25] => (item={u'enabled': False, u'name': u'outward-rabbitmq'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'panko'}) \nchanged: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'rabbitmq'})\nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'rally'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'sahara'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'searchlight'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'senlin'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'skydive'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'solum'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'swift'}) \nchanged: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'tacker'})\nchanged: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'tempest'})\nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'trove'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'watcher'}) \nskipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'zun'}) \n\nTASK [common : Check common containers] ****\nchanged: [10.197.121.25] => (item={'key': u'cron', 'value': {u'environment': {u'DUMMY_ENVIRONMENT': u'kolla_useless_env'}, u'image': u'10.197.121.25:4000/kolla/ubuntu-source-cron:5.0.2 ', u'volumes': [u'/etc/kolla//cron/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'kolla_logs:/var/log/kolla/'], u'container_name': u'cron'}})\nchanged: [10.197.121.25] => (item={'key': u'fluentd', 'value': {u'environment': {u'KOLLA_CONFIG_STRATEGY': u'COPY_ALWAYS'}, u'image': u'10.197.121.25:4000/kolla/ubuntu-source-fluentd:5.0.2 ', u'volumes': [u'/etc/kolla//fluentd/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'kolla_logs:/var/log/kolla/'], u'container_name': u'fluentd'}})\nchanged: [10.197.121.25] => (item={'key': u'kolla-toolbox', 'value': {u'environment': {u'ANSIBLE_LIBRARY': u'/usr/share/ansible', u'ANSIBLE_NOCOLOR': u'1'}, u'image': u'10.197.121.25:4000/kolla/ubuntu-source-kolla-toolbox:5.0.2 ', u'privileged': True, u'volumes': [u'/etc/kolla//kolla-toolbox/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'/dev/:/dev/', u'/run/:/run/:shared', u'kolla_logs:/var/log/kolla/'], u'container_name': u'kolla_toolbox'}})\n\nTASK [common : include] ****\nincluded: /usr/local/share/kolla-ansible/ansible/roles/common/tasks/bootstrap.yml for 10.197.121.25\n\nTASK [common : Creating log volume] ****\nok: [10.197.121.25]\n\nRUNNING HANDLER [common : Restart fluentd container] ***\nfatal: [10.197.121.25]: FAILED! => {\"changed\": true, \"failed\": true, \"msg\": \"'Traceback (most recent call last):\\n File \\"/tmp/ansible_L0ngGs/ansible_module_kolla_docker.py\\", line 799, in main\\n result = bool(getattr(dw, module.params.get(\\'action\\'))())\\n File \\"/tmp/ansible_L0ngGs/ansible_module_kolla_docker.py\\", line 590, in recreate_or_restart_container\\n self.start_container()\\n File \\"/tmp/ansible_L0ngGs/ansible_module_kolla_docker.py\\", line 603, in start_container\\n self.pull_image()\\n File \\"/tmp/ansible_L0ngGs/ansible_module_kolla_docker.py\\", line 456, in pull_image\\n repository=image, tag=tag, stream=True\\n File \\"/usr/local/lib/python2.7/dist-packages/docker/api/image.py\\", line 393, in pull\\n self._raise_for_status(response)\\n File \\"/usr/local/lib/python2.7/dist-packages/docker/api/client.py\\", line 224, in _raise_for_status\\n raise create_api_error_from_http_exception(e)\\n File \\"/usr/local/lib/python2.7/dist-packages/docker/errors.py\\", line 31, in create_api_error_from_http_exception\\n raise cls(e, response=response, explanation=explanation)\\nAPIError: 500 Server Error: Internal Server Error (\\"invalid tag format\\")\\n'\"}\n\nRUNNING HANDLER [common : Restart kolla-toolbox container] *\n\nRUNNING HANDLER [common : Restart cron container] **\n\tto retry, use: --limit @/usr/local/share/kolla-ansible/ansible/site.retry\n\nPLAY RECAP *\n10.197.121.25 : ok=14 changed=9 unreachable=0 failed=1 \n10.197.121.26 : ok=1 changed=0 unreachable=0 failed=0 \nlocalhost : ok=1 changed=0 unreachable=0 failed=0 \n\nCommand failed ansible-playbook -i /etc/kolla_packages/source/inventory/multinode -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla -e action=deploy /usr/local/share/kolla-ansible/ansible/site.yml ", "stdout_lines": ["Deploying Playbooks : ansible-playbook -i /etc/kolla_packages/source/inventory/multinode -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla -e action=deploy /usr/local/share/kolla-ansible/ansible/site.yml ", "", "PLAY [Gather facts for all hosts] ****", "", "TASK [setup] *", "ok: [localhost]", "ok: [10.197.121.25]", "ok: [10.197.121.26]", "", "PLAY [Gather facts for all hosts (if using --limit)] *", "", "TASK [setup] *****", "skipping: [10.197.121.25] => (item=10.197.121.25) ", "skipping: [localhost] => (item=10.197.121.25) ", "skipping: [localhost] => (item=localhost) ", "skipping: [localhost] => (item=10.197.121.26) ", "skipping: [10.197.121.26] => (item=localhost) ", "skipping: [10.197.121.26] => (item=10.197.121.26) ", "skipping: [10.197.121.26] => (item=10.197.121.25) ", "skipping: [10.197.121.25] => (item=localhost) ", "skipping: [10.197.121.25] => (item=10.197.121.26) ", "", "PLAY [Detect openstack_release variable] *****", "", "TASK [Get current kolla-ansible version number] ****", "skipping: [10.197.121.25]", "skipping: [10.197.121.26]", "skipping: [localhost]", "", "TASK [Set openstack_release variable] **", "skipping: [10.197.121.25]", "skipping: [10.197.121.26]", "skipping: [localhost]", "", "PLAY [Apply role prechecks] ****", "", "TASK [prechecks : Checking the api_interface is present] *", "skipping: [10.197.121.25]", "skipping: [10.197.121.26]", "skipping: [localhost]", "", "TASK [prechecks : Checking the api_interface is active] ****", "skipping: [10.197.121.25]", "skipping: [10.197.121.26]", "skipping: [localhost]", "", "TASK [prechecks : Checking the api_interface configuration] ****", "skipping: [10.197.121.25]", "skipping: [10.197.121.26]", "skipping: [localhost]", "", "TASK [prechecks : Checking the api_interface ip address configuration] *", "skipping: [10.197.121.25]", "skipping: [10.197.121.26]", "skipping: [localhost]", "", "TASK [prechecks : Checking Docker version] *****", "skipping: [10.197.121.25]", "skipping: [10.197.121.26]", "skipping: [localhost]", "", "TASK [prechecks : Checking empty passwords in passwords.yml. Run kolla-genpwd if this task fails] *", "skipping: [10.197.121.25]", "", "TASK [prechecks : Checking docker SDK version] ***", "skipping: [10.197.121.25]", "skipping: [10.197.121.26]", "skipping: [localhost]", "", "TASK [prechecks : Checking Ansible version] ****", "skipping: [10.197.121.25]", "", "PLAY [Apply role chrony] *", "", "TASK [common : include] **", "skipping: [10.197.121.25]", "skipping: [10.197.121.26]", "", "TASK [common : Registering common role has run] ****", "skipping: [10.197.121.25]", "skipping: [10.197.121.26]", "", "TASK [chrony : include] ****", "skipping: [10.197.121.25]", "skipping: [10.197.121.26]", "", "PLAY [Apply role collectd] *", "", "TASK [common : include] ****", "skipping: [10.197.121.26]", "", "TASK [common : Registering common role has run] ****", "skipping: [10.197.121.26]", "", "TASK [collectd : include] **", "skipping: [10.197.121.26]", "", "PLAY [Apply role elasticsearch] ****", "", "TASK [common : include] ****", "skipping: [10.197.121.25]", "", "TASK [common : Registering common role has run] ****", "skipping: [10.197.121.25]", "", "TASK [elasticsearch : include] *", "skipping: [10.197.121.25]", "", "PLAY [Apply role telegraf] *****", "", "TASK [common : include] ****", "skipping: [10.197.121.26]", "skipping: [10.197.121.25]", "", "TASK [common : Registering common role has run] ****", "skipping: [10.197.121.26]", "skipping: [10.197.121.25]", "", "TASK [telegraf : include] **", "skipping: [10.197.121.26]", "skipping: [10.197.121.25]", "", "PLAY [Apply role redis] ****", "", "TASK [common : include] ****", "included: /usr/local/share/kolla-ansible/ansible/roles/common/tasks/deploy.yml for 10.197.121.25", "", "TASK [common : include] ****", "included: /usr/local/share/kolla-ansible/ansible/roles/common/tasks/config.yml for 10.197.121.25", "", "TASK [common : Ensuring config directories exist] **", "changed: [10.197.121.25] => (item=fluentd)", "changed: [10.197.121.25] => (item=fluentd/input)", "changed: [10.197.121.25] => (item=fluentd/output)", "changed: [10.197.121.25] => (item=fluentd/format)", "changed: [10.197.121.25] => (item=fluentd/filter)", "changed: [10.197.121.25] => (item=kolla-toolbox)", "changed: [10.197.121.25] => (item=cron)", "changed: [10.197.121.25] => (item=cron/logrotate)", "", "TASK [common : Copying over config.json files for services] ****", "changed: [10.197.121.25] => (item={'key': u'cron', 'value': {u'environment': {u'DUMMY_ENVIRONMENT': u'kolla_useless_env'}, u'image': u'10.197.121.25:4000/kolla/ubuntu-source-cron:5.0.2 ', u'volumes': [u'/etc/kolla//cron/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'kolla_logs:/var/log/kolla/'], u'container_name': u'cron'}})", "changed: [10.197.121.25] => (item={'key': u'fluentd', 'value': {u'environment': {u'KOLLA_CONFIG_STRATEGY': u'COPY_ALWAYS'}, u'image': u'10.197.121.25:4000/kolla/ubuntu-source-fluentd:5.0.2 ', u'volumes': [u'/etc/kolla//fluentd/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'kolla_logs:/var/log/kolla/'], u'container_name': u'fluentd'}})", "changed: [10.197.121.25] => (item={'key': u'kolla-toolbox', 'value': {u'environment': {u'ANSIBLE_LIBRARY': u'/usr/share/ansible', u'ANSIBLE_NOCOLOR': u'1'}, u'image': u'10.197.121.25:4000/kolla/ubuntu-source-kolla-toolbox:5.0.2 ', u'privileged': True, u'volumes': [u'/etc/kolla//kolla-toolbox/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'/dev/:/dev/', u'/run/:/run/:shared', u'kolla_logs:/var/log/kolla/'], u'container_name': u'kolla_toolbox'}})", "", "TASK [common : Copying over fluentd input config files] ****", "changed: [10.197.121.25] => (item=00-global)", "changed: [10.197.121.25] => (item=01-syslog)", "changed: [10.197.121.25] => (item=02-mariadb)", "changed: [10.197.121.25] => (item=03-rabbitmq)", "changed: [10.197.121.25] => (item=04-openstack-wsgi)", "", "TASK [common : Copying over fluentd output config files] ", "changed: [10.197.121.25] => (item={u'enabled': True, u'name': u'00-local'})", "skipping: [10.197.121.25] => (item={u'enabled': False, u'name': u'01-es'}) ", "", "TASK [common : Copying over fluentd format config files] ", "changed: [10.197.121.25] => (item=apache_access)", "changed: [10.197.121.25] => (item=wsgi_access)", "", "TASK [common : Copying over fluentd filter config files] *", "changed: [10.197.121.25] => (item={u'dest': u'00-record_transformer', u'src': u'00-record_transformer'})", "changed: [10.197.121.25] => (item={u'dest': u'01-rewrite', u'src': u'01-rewrite-0.14'})", "", "TASK [common : Copying over td-agent.conf] ***", "changed: [10.197.121.25] => (item=fluentd)", "", "TASK [common : Copying over cron logrotate config files] *", "changed: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'ansible'})", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'aodh'}) ", "changed: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'barbican'})", "changed: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'ceilometer'})", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'ceph'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'chrony'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'cinder'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'cloudkitty'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'collectd'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'congress'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'designate'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'elasticsearch'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'etcd'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'freezer'}) ", "changed: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'glance'})", "changed: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'global'})", "changed: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'gnocchi'})", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'grafana'}) ", "changed: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'haproxy'})", "changed: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'heat'})", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'influxdb'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'ironic'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'ironic-inspector'}) ", "skipping: [10.197.121.25] => (item={u'enabled': False, u'name': u'iscsid'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'karbor'}) ", "changed: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'keepalived'})", "changed: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'keystone'})", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'kibana'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'kuryr'}) ", "changed: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'magnum'})", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'manila'}) ", "changed: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'mariadb'})", "changed: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'mistral'})", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'mongodb'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'murano'}) ", "changed: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'neutron'})", "changed: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'nova'})", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'octavia'}) ", "skipping: [10.197.121.25] => (item={u'enabled': False, u'name': u'outward-rabbitmq'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'panko'}) ", "changed: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'rabbitmq'})", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'rally'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'sahara'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'searchlight'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'senlin'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'skydive'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'solum'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'swift'}) ", "changed: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'tacker'})", "changed: [10.197.121.25] => (item={u'enabled': u'yes', u'name': u'tempest'})", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'trove'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'watcher'}) ", "skipping: [10.197.121.25] => (item={u'enabled': u'no', u'name': u'zun'}) ", "", "TASK [common : Check common containers] ****", "changed: [10.197.121.25] => (item={'key': u'cron', 'value': {u'environment': {u'DUMMY_ENVIRONMENT': u'kolla_useless_env'}, u'image': u'10.197.121.25:4000/kolla/ubuntu-source-cron:5.0.2 ', u'volumes': [u'/etc/kolla//cron/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'kolla_logs:/var/log/kolla/'], u'container_name': u'cron'}})", "changed: [10.197.121.25] => (item={'key': u'fluentd', 'value': {u'environment': {u'KOLLA_CONFIG_STRATEGY': u'COPY_ALWAYS'}, u'image': u'10.197.121.25:4000/kolla/ubuntu-source-fluentd:5.0.2 ', u'volumes': [u'/etc/kolla//fluentd/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'kolla_logs:/var/log/kolla/'], u'container_name': u'fluentd'}})", "changed: [10.197.121.25] => (item={'key': u'kolla-toolbox', 'value': {u'environment': {u'ANSIBLE_LIBRARY': u'/usr/share/ansible', u'ANSIBLE_NOCOLOR': u'1'}, u'image': u'10.197.121.25:4000/kolla/ubuntu-source-kolla-toolbox:5.0.2 ', u'privileged': True, u'volumes': [u'/etc/kolla//kolla-toolbox/:/var/lib/kolla/config_files/:ro', u'/etc/localtime:/etc/localtime:ro', u'/dev/:/dev/', u'/run/:/run/:shared', u'kolla_logs:/var/log/kolla/'], u'container_name': u'kolla_toolbox'}})", "", "TASK [common : include] ****", "included: /usr/local/share/kolla-ansible/ansible/roles/common/tasks/bootstrap.yml for 10.197.121.25", "", "TASK [common : Creating log volume] ****", "ok: [10.197.121.25]", "", "RUNNING HANDLER [common : Restart fluentd container] *****", "fatal: [10.197.121.25]: FAILED! => {\"changed\": true, \"failed\": true, \"msg\": \"'Traceback (most recent call last):\\n File \\"/tmp/ansible_L0ngGs/ansible_module_kolla_docker.py\\", line 799, in main\\n result = bool(getattr(dw, module.params.get(\\'action\\'))())\\n File \\"/tmp/ansible_L0ngGs/ansible_module_kolla_docker.py\\", line 590, in recreate_or_restart_container\\n self.start_container()\\n File \\"/tmp/ansible_L0ngGs/ansible_module_kolla_docker.py\\", line 603, in start_container\\n self.pull_image()\\n File \\"/tmp/ansible_L0ngGs/ansible_module_kolla_docker.py\\", line 456, in pull_image\\n repository=image, tag=tag, stream=True\\n File \\"/usr/local/lib/python2.7/dist-packages/docker/api/image.py\\", line 393, in pull\\n self._raise_for_status(response)\\n File \\"/usr/local/lib/python2.7/dist-packages/docker/api/client.py\\", line 224, in _raise_for_status\\n raise create_api_error_from_http_exception(e)\\n File \\"/usr/local/lib/python2.7/dist-packages/docker/errors.py\\", line 31, in create_api_error_from_http_exception\\n raise cls(e, response=response, explanation=explanation)\\nAPIError: 500 Server Error: Internal Server Error (\\"invalid tag format\\")\\n'\"}", "", "RUNNING HANDLER [common : Restart kolla-toolbox container] *", "", "RUNNING HANDLER [common : Restart cron container] **", "\tto retry, use: --limit @/usr/local/share/kolla-ansible/ansible/site.retry", "", "PLAY RECAP *****", "10.197.121.25 : ok=14 changed=9 unreachable=0 failed=1 ", "10.197.121.26 : ok=1 changed=0 unreachable=0 failed=0 ", "localhost : ok=1 changed=0 unreachable=0 failed=0 ", "", "Command failed ansible-playbook -i /etc/kolla_packages/source/inventory/multinode -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla -e action=deploy /usr/local/share/kolla-ansible/ansible/site.yml "], "warnings": []}

chiraggupta06 commented 6 years ago

Hi, please provide deployment.yaml used as we suspect that the issue might be with tag provided in the deployment.yaml file.

Br, chirag gupta

penaivanalejandro commented 6 years ago

Hi, Thank you for attending and any detail to correct is very helpful ...

deployment.yaml.txt

chiraggupta06 commented 6 years ago

Hi, deployment.yaml seems fine, however please check if there is any dangling docker images present . you can check for dangling images via command "docker images". if present please remove the dangling images via command: docker rmi $(docker images --quiet --filter "dangling=true") after that cleanup and redeploy(with -d option(deploy without building images) ).

penaivanalejandro commented 6 years ago

Hi Thanks for the tip about the dangling docker images I use the command for check: docker images --filter "dangling=true" And show me this dangling.txt

Use your command: docker rmi $(docker images --quiet --filter "dangling=true") and have the response: rmi.txt are the last lines of the response.

And check again with docker images --filter "dangling=true" and response with: dangling2.txt

Next I run again de deployment like this: python iaas_launch.py -f conf/openstack/kolla/deployment.yaml -d

And show me the next error (LOG here console.txt): "TASK [nova : include] **", "included: /usr/local/share/kolla-ansible/ansible/roles/nova/tasks/bootstrap_service.yml for 10.197.121.26", "", "TASK [nova : Running Nova bootstrap container] ***", "fatal: [10.197.121.26 -> 10.197.121.25]: FAILED! => {\"changed\": true, \"failed\": true, \"msg\": \"'Traceback (most recent call last):\\n File \\"/tmp/ansible_eU6LQu/ansible_module_kolla_docker.py\\", line 799, in main\\n result = bool(getattr(dw, module.params.get(\\'action\\'))())\\n File \\"/tmp/ansible_eU6LQu/ansible_module_kolla_docker.py\\", line 602, in start_container\\n if not self.check_image():\\n File \\"/tmp/ansible_eU6LQu/ansible_module_kolla_docker.py\\", line 251, in check_image\\n for image in self.dc.images():\\n File \\"/usr/local/lib/python2.7/dist-packages/docker/api/image.py\\", line 93, in images\\n res = self._result(self._get(self._url(\\"/images/json\\"), params=params),\\n File \\"/usr/local/lib/python2.7/dist-packages/docker/utils/decorators.py\\", line 46, in inner\\n return f(self, *args, kwargs)\\n File \\"/usr/local/lib/python2.7/dist-packages/docker/api/client.py\\", line 191, in _get\\n return self.get(url, self._set_request_timeout(kwargs))\\n File \\"/usr/local/lib/python2.7/dist-packages/requests/sessions.py\\", line 521, in get\\n return self.request(\\'GET\\', url, kwargs)\\n File \\"/usr/local/lib/python2.7/dist-packages/requests/sessions.py\\", line 508, in request\\n resp = self.send(prep, send_kwargs)\\n File \\"/usr/local/lib/python2.7/dist-packages/requests/sessions.py\\", line 618, in send\\n r = adapter.send(request, kwargs)\\n File \\"/usr/local/lib/python2.7/dist-packages/requests/adapters.py\\", line 521, in send\\n raise ReadTimeout(e, request=request)\\nReadTimeout: UnixHTTPConnectionPool(host=\\'localhost\\', port=None): Read timed out. (read timeout=60)\\n'\"}", "", "NO MORE HOSTS LEFT *", "\tto retry, use: --limit @/usr/local/share/kolla-ansible/ansible/site.retry", "", "PLAY RECAP *****", "10.197.121.25 : ok=142 changed=84 unreachable=0 failed=1 ", "10.197.121.26 : ok=36 changed=24 unreachable=0 failed=1 ", "localhost : ok=1 changed=0 unreachable=0 failed=0 ", "", "Command failed ansible-playbook -i /etc/kolla_packages/source/inventory/multinode -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla -e action=deploy /usr/local/share/kolla-ansible/ansible/site.yml "], "warnings": []}

chiraggupta06 commented 6 years ago

Hi, From the file dangling2.txt, we can see that dangling images are still present. Please remove the same before proceeding. Also, have you performed the cleanup before redeployment?

Below are the steps for the redeployment.

In case previous deployment attempt has failed or new changes are required (enabling optional services), attempt following steps.

First, Clean up previous OpenStack deployment:

sudo python iaas_launch.py -f conf/openstack/kolla/deployment.yaml -c

Then, re-install OpenStack. If docker repository exists:

sudo python iaas_launch.py -f conf/openstack/kolla/deployment.yaml -d

Regards, Chirag Gupta

penaivanalejandro commented 6 years ago

Hi, again...

Now show me this error...

"TASK [haproxy : Checking if kolla_internal_vip_address and kolla_external_vip_address are not pingable from any node] *", "failed: [10.197.121.25] (item=10.197.121.30) => {\"changed\": false, \"cmd\": [\"ping\", \"-c\", \"3\", \"10.197.121.30\"], \"delta\": \"0:00:02.070147\", \"end\": \"2018-02-06 18:53:34.795131\", \"failed\": true, \"failed_when_result\": true, \"item\": \"10.197.121.30\", \"rc\": 0, \"start\": \"2018-02-06 18:53:32.724984\", \"stderr\": \"\", \"stdout\": \"PING 10.197.121.30 (10.197.121.30) 56(84) bytes of data.\n64 bytes from 10.197.121.30: icmp_seq=1 ttl=64 time=0.034 ms\n64 bytes from 10.197.121.30: icmp_seq=2 ttl=64 time=0.057 ms\n64 bytes from 10.197.121.30: icmp_seq=3 ttl=64 time=0.058 ms\n\n--- 10.197.121.30 ping statistics ---\n3 packets transmitted, 3 received, 0% packet loss, time 2041ms\nrtt min/avg/max/mdev = 0.034/0.049/0.058/0.013 ms\", \"stdout_lines\": [\"PING 10.197.121.30 (10.197.121.30) 56(84) bytes of data.\", \"64 bytes from 10.197.121.30: icmp_seq=1 ttl=64 time=0.034 ms\", \"64 bytes from 10.197.121.30: icmp_seq=2 ttl=64 time=0.057 ms\", \"64 bytes from 10.197.121.30: icmp_seq=3 ttl=64 time=0.058 ms\", \"\", \"--- 10.197.121.30 ping statistics ---\", \"3 packets transmitted, 3 received, 0% packet loss, time 2041ms\", \"rtt min/avg/max/mdev = 0.034/0.049/0.058/0.013 ms\"], \"warnings\": []}", "failed: [10.197.121.25] (item=10.197.123.30) => {\"changed\": false, \"cmd\": [\"ping\", \"-c\", \"3\", \"10.197.123.30\"], \"delta\": \"0:00:02.027642\", \"end\": \"2018-02-06 18:53:36.970922\", \"failed\": true, \"failed_when_result\": true, \"item\": \"10.197.123.30\", \"rc\": 0, \"start\": \"2018-02-06 18:53:34.943280\", \"stderr\": \"\", \"stdout\": \"PING 10.197.123.30 (10.197.123.30) 56(84) bytes of data.\n64 bytes from 10.197.123.30: icmp_seq=1 ttl=64 time=0.031 ms\n64 bytes from 10.197.123.30: icmp_seq=2 ttl=64 time=0.026 ms\n64 bytes from 10.197.123.30: icmp_seq=3 ttl=64 time=0.039 ms\n\n--- 10.197.123.30 ping statistics ---\n3 packets transmitted, 3 received, 0% packet loss, time 2025ms\nrtt min/avg/max/mdev = 0.026/0.032/0.039/0.005 ms\", \"stdout_lines\": [\"PING 10.197.123.30 (10.197.123.30) 56(84) bytes of data.\", \"64 bytes from 10.197.123.30: icmp_seq=1 ttl=64 time=0.031 ms\", \"64 bytes from 10.197.123.30: icmp_seq=2 ttl=64 time=0.026 ms\", \"64 bytes from 10.197.123.30: icmp_seq=3 ttl=64 time=0.039 ms\", \"\", \"--- 10.197.123.30 ping statistics ---\", \"3 packets transmitted, 3 received, 0% packet loss, time 2025ms\", \"rtt min/avg/max/mdev = 0.026/0.032/0.039/0.005 ms\"], \"warnings\": []}", "\tto retry, use: --limit @/usr/local/share/kolla-ansible/ansible/site.retry", "", "PLAY RECAP ***", "10.197.121.25 : ok=14 changed=0 unreachable=0 failed=1 ", "10.197.121.26 : ok=3 changed=0 unreachable=0 failed=0 ", "localhost : ok=1 changed=0 unreachable=0 failed=0 ", "", "Command failed ansible-playbook -i /etc/kolla_packages/source/inventory/multinode -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla -e action=precheck /usr/local/share/kolla-ansible/ansible/site.yml "], "warnings": []}

From the Config node: root@ConfigNode:/home/ipena/snaps-openstack/snaps-openstack# ping 10.197.121.30 PING 10.197.121.30 (10.197.121.30) 56(84) bytes of data. 64 bytes from 10.197.121.30: icmp_seq=1 ttl=64 time=0.615 ms 64 bytes from 10.197.121.30: icmp_seq=2 ttl=64 time=0.254 ms 64 bytes from 10.197.121.30: icmp_seq=3 ttl=64 time=0.523 ms ^C --- 10.197.121.30 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 1998ms rtt min/avg/max/mdev = 0.254/0.464/0.615/0.153 ms root@ConfigNode:/home/ipena/snaps-openstack/snaps-openstack#

From the controller node: root@CONTROLLER222362:~# ping 10.197.121.30 PING 10.197.121.30 (10.197.121.30) 56(84) bytes of data. 64 bytes from 10.197.121.30: icmp_seq=1 ttl=64 time=0.057 ms 64 bytes from 10.197.121.30: icmp_seq=2 ttl=64 time=0.062 ms 64 bytes from 10.197.121.30: icmp_seq=3 ttl=64 time=0.028 ms ^C --- 10.197.121.30 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2048ms rtt min/avg/max/mdev = 0.028/0.049/0.062/0.015 ms root@CONTROLLER222362:~#

chiraggupta06 commented 6 years ago

Hi, From the error logs we can see that virtual ip is pingable (already occupied).

So please perform below steps:

Clean up first using -c option .
Make sure that kolla_internal_vip_address and kolla_external_vip_address(mentioned in deployment.yaml) should not be pingable.
Deploy again using -d option.

Regards, Chirag Gupta.

cablelabs / snaps-openstack

invalid tag format, TASK [kolla ansible deploy] #75