search

redhat-openstack / infrared

Plugin based framework that aims to provide an easy-to-use CLI for Ansible based projects
https://infrared.readthedocs.io/en/latest/index.html
Apache License 2.0
99 stars 97 forks source link

Tester node not configured for infrared tempest plugin #334

Closed FedericoRessi closed 6 years ago

FedericoRessi commented 6 years ago

Just after installing a cloud (virsh + tripleo-undercloud + tipleo-overcloud) I tried to use infrared tempest plugin to run neutron-tempest-plugin tests but infrared tempest plugin failed to execute setup tasks.

These are the commands I executed to setup my cloud on a RHEL 7.5:

$ infrared virsh \
  --host-address localhost \
  --host-key '~/.ssh/id_rsa' \
  --topology-nodes undercloud:1,controller:1,compute:2,tester:1 \
  --host-memory-overcommit False

$ infrared tripleo-undercloud \
  --version 10

$ infrared tripleo-undercloud \
  --images-task rpm \
  --images-update yes \
  --mirror tlv

$ infrared tripleo-overcloud \
  --version 10 \
  --deployment-files virt \
  --introspect yes \
  --vbmc-force False \
  --tagging no \
  --deploy no \
  --post no

$ infrared tripleo-overcloud \
  --version 10 \
  --deployment-files virt \
  --introspect no \
  --tagging yes \
  --deploy no \
  --post no

$ infrared tripleo-overcloud \
  --version 10 \
  --deployment-files virt \
  --overcloud-templates none \
  --storage-backend lvm \
  --overcloud-ssl no \
  --network-backend vlan \
  --network-protocol ipv4 \
  --network-bgpvpn no \
  --network-dvr no \
  --network-l2gw no \
  --storage-external no \
  --overcloud-debug yes \
  --introspect no \
  --tagging no \
  --deploy yes \
  --post no

$ infrared tripleo-overcloud \
  --version 10 \
  --deployment-files virt \
  --public-subnet default_subnet \
  --introspect no \
  --tagging no \
  --deploy no \
  --post yes

Please find here attached infrared.log file with more details: infrared.log

Above commands has been successful and I got my tester-0 VM for executing tempest tests. So I tried executing infrared tempest command.

using 'rpm' setup

$ infrared tempest \
  --openstack-installer tripleo \
  --openstack-version 10 \
  --mode normal \
  --plugin https://git.openstack.org/openstack/neutron-tempest-plugin \
  --results-formats junitxml,html
  --tests all

It failed after below error:

TASK [Setup tempest] ***********************************************************
included: /root/.tobiko/infrared/src/infrared/plugins/tempest/tasks/setup/rpm/main.yml for tester-0, undercloud-0

TASK [Install tempest from rpm] ************************************************
ok: [undercloud-0]
fatal: [tester-0]: FAILED! => {"changed": false, "msg": "No package matching 'openstack-tempest' found available, installed or updated", "rc": 126, "results": ["No package matching 'openstack-tempest' found available, installed or updated"]}

using 'pip' setup

$ infrared tempest \
  --openstack-installer tripleo \
  --openstack-version 10 \
  --mode normal --plugin https://git.openstack.org/openstack/neutron-tempest-plugin \
  --results-formats junitxml,html \
  --setup pip \
  --tests all

It failed after below error:

TASK [Setup tempest] ***********************************************************
included: /root/.tobiko/infrared/src/infrared/plugins/tempest/tasks/setup/pip/main.yml for tester-0, undercloud-0

TASK [Install devel packages for package build dependencies] *******************
failed: [tester-0] (item=[u'gcc', u'git', u'libffi-devel', u'libxml2-devel', u'libxslt-devel', u'mariadb-devel', u'openssl-devel', u'python-virtualenv', u'python-setuptools']) => {"changed": false, "item": ["gcc", "git", "libffi-devel", "libxml2-devel", "libxslt-devel", "mariadb-devel", "openssl-devel", "python-virtualenv", "python-setuptools"], "msg": "No package matching 'gcc' found available, installed or updated", "rc": 126, "results": ["No package matching 'gcc' found available, installed or updated"]}
changed: [undercloud-0] => (item=[u'gcc', u'git', u'libffi-devel', u'libxml2-devel', u'libxslt-devel', u'mariadb-devel', u'openssl-devel', u'python-virtualenv', u'python-setuptools'])

using 'git' setup

$ infrared tempest \
  --openstack-installer tripleo \
  --openstack-version 10 \
  --mode normal \
  --plugin https://git.openstack.org/openstack/neutron-tempest-plugin \
  --results-formats junitxml,html \
  --setup git \
  --tests all

It failed after below error:

TASK [Setup tempest] ***********************************************************
included: /root/.tobiko/infrared/src/infrared/plugins/tempest/tasks/setup/git/main.yml for tester-0, undercloud-0

TASK [Install devel packages for package build dependencies] *******************
failed: [tester-0] (item=gcc) => {"changed": false, "item": "gcc", "msg": "No package matching 'gcc' found available, installed or updated", "rc": 126, "results": ["No package matching 'gcc' found available, installed or updated"]}
ok: [undercloud-0] => (item=gcc)
failed: [tester-0] (item=git) => {"changed": false, "item": "git", "msg": "No package matching 'git' found available, installed or updated", "rc": 126, "results": ["No package matching 'git' found available, installed or updated"]}
ok: [undercloud-0] => (item=git)
failed: [tester-0] (item=libffi-devel) => {"changed": false, "item": "libffi-devel", "msg": "No package matching 'libffi-devel' found available, installed or updated", "rc": 126, "results": ["No package matching 'libffi-devel' found available, installed or updated"]}
ok: [undercloud-0] => (item=libffi-devel)
failed: [tester-0] (item=libxml2-devel) => {"changed": false, "item": "libxml2-devel", "msg": "No package matching 'libxml2-devel' found available, installed or updated", "rc": 126, "results": ["No package matching 'libxml2-devel' found available, installed or updated"]}
ok: [undercloud-0] => (item=libxml2-devel)
failed: [tester-0] (item=libxslt-devel) => {"changed": false, "item": "libxslt-devel", "msg": "No package matching 'libxslt-devel' found available, installed or updated", "rc": 126, "results": ["No package matching 'libxslt-devel' found available, installed or updated"]}
ok: [undercloud-0] => (item=libxslt-devel)
ok: [undercloud-0] => (item=mariadb-devel)
failed: [tester-0] (item=mariadb-devel) => {"changed": false, "item": "mariadb-devel", "msg": "No package matching 'mariadb-devel' found available, installed or updated", "rc": 126, "results": ["No package matching 'mariadb-devel' found available, installed or updated"]}
ok: [undercloud-0] => (item=openssl-devel)
failed: [tester-0] (item=openssl-devel) => {"changed": false, "item": "openssl-devel", "msg": "No package matching 'openssl-devel' found available, installed or updated", "rc": 126, "results": ["No package matching 'openssl-devel' found available, installed or updated"]}
ok: [undercloud-0] => (item=python-virtualenv)
failed: [tester-0] (item=python-virtualenv) => {"changed": false, "item": "python-virtualenv", "msg": "No package matching 'python-virtualenv' found available, installed or updated", "rc": 126, "results": ["No package matching 'python-virtualenv' found available, installed or updated"]}
ok: [undercloud-0] => (item=python-setuptools)
ok: [tester-0] => (item=python-setuptools)
FedericoRessi commented 6 years ago

I think I understood the root cause of the problem. I executed below command from hypervisor host:

$ ssh tester-0 sudo yum install gcc
Loaded plugins: search-disabled-repos
There are no enabled repos.
 Run "yum repolist all" to see the repos you have.
 To enable Red Hat Subscription Management repositories:
     subscription-manager repos --enable <repo>
 To enable custom repositories:
     yum-config-manager --enable <repo>
FedericoRessi commented 6 years ago

I tried to workaround the problem by executing below commands on tester node:

$ subscription-manager register

$ subscription-manager attach --auto

Anyway some rpms like openstack-tempest and python-neutron-tests are still not available.

rpm setup

TASK [Install tempest from rpm] ************************************************
ok: [undercloud-0]
fatal: [tester-0]: FAILED! => {"changed": false, "msg": "No package matching 'openstack-tempest' found available, installed or updated", "rc": 126, "results": ["No package matching 'openstack-tempest' found available, installed or updated"]}

pip setup

TASK [Install test dependency] *************************************************
changed: [undercloud-0] => (item=python-heat-tests)
changed: [undercloud-0] => (item=python-ceilometer-tests)
failed: [tester-0] (item=python-heat-tests) => {"changed": false, "item": "python-heat-tests", "msg": "No package matching 'python-heat-tests' found available, installed or updated", "rc": 126, "results": ["No package matching 'python-heat-tests' found available, installed or updated"]}
changed: [undercloud-0] => (item=python-keystone-tests)
changed: [undercloud-0] => (item=python-aodh-tests)
changed: [undercloud-0] => (item=python-neutron-tests)
failed: [tester-0] (item=python-ceilometer-tests) => {"changed": false, "item": "python-ceilometer-tests", "msg": "No package matching 'python-ceilometer-tests' found available, installed or updated", "rc": 126, "results": ["No package matching 'python-ceilometer-tests' found available, installed or updated"]}
changed: [undercloud-0] => (item=python-neutron-fwaas-tests)
failed: [tester-0] (item=python-keystone-tests) => {"changed": false, "item": "python-keystone-tests", "msg": "No package matching 'python-keystone-tests' found available, installed or updated", "rc": 126, "results": ["No package matching 'python-keystone-tests' found available, installed or updated"]}
changed: [undercloud-0] => (item=python-cinder-tests)
changed: [undercloud-0] => (item=python-gabbi)
changed: [undercloud-0] => (item=python-zaqar-tests)
failed: [tester-0] (item=python-aodh-tests) => {"changed": false, "item": "python-aodh-tests", "msg": "No package matching 'python-aodh-tests' found available, installed or updated", "rc": 126, "results": ["No package matching 'python-aodh-tests' found available, installed or updated"]}
changed: [undercloud-0] => (item=python-ironic-tests)
changed: [undercloud-0] => (item=python-mistral-tests)
failed: [tester-0] (item=python-neutron-tests) => {"changed": false, "item": "python-neutron-tests", "msg": "No package matching 'python-neutron-tests' found available, installed or updated", "rc": 126, "results": ["No package matching 'python-neutron-tests' found available, installed or updated"]}
failed: [tester-0] (item=python-neutron-fwaas-tests) => {"changed": false, "item": "python-neutron-fwaas-tests", "msg": "No package matching 'python-neutron-fwaas-tests' found available, installed or updated", "rc": 126, "results": ["No package matching 'python-neutron-fwaas-tests' found available, installed or updated"]}
failed: [tester-0] (item=python-cinder-tests) => {"changed": false, "item": "python-cinder-tests", "msg": "No package matching 'python-cinder-tests' found available, installed or updated", "rc": 126, "results": ["No package matching 'python-cinder-tests' found available, installed or updated"]}
failed: [tester-0] (item=python-gabbi) => {"changed": false, "item": "python-gabbi", "msg": "No package matching 'python-gabbi' found available, installed or updated", "rc": 126, "results": ["No package matching 'python-gabbi' found available, installed or updated"]}
failed: [tester-0] (item=python-zaqar-tests) => {"changed": false, "item": "python-zaqar-tests", "msg": "No package matching 'python-zaqar-tests' found available, installed or updated", "rc": 126, "results": ["No package matching 'python-zaqar-tests' found available, installed or updated"]}
failed: [tester-0] (item=python-ironic-tests) => {"changed": false, "item": "python-ironic-tests", "msg": "No package matching 'python-ironic-tests' found available, installed or updated", "rc": 126, "results": ["No package matching 'python-ironic-tests' found available, installed or updated"]}
failed: [tester-0] (item=python-mistral-tests) => {"changed": false, "item": "python-mistral-tests", "msg": "No package matching 'python-mistral-tests' found available, installed or updated", "rc": 126, "results": ["No package matching 'python-mistral-tests' found available, installed or updated"]}

git setup

It looks like there is no problem with missing rpms. It fails later anyway with below error:

TASK [Run tempest configuration tool] ******************************************
fatal: [tester-0]: FAILED! => {"changed": true, "cmd": "test -e ~/.virtualenvs/.tempest_conf/bin/activate && source ~/.virtualenvs/.tempest_conf/bin/activate\n source ~/keystonerc\n discover-tempest-config  --deployer-input ~/ir-tempest-deployer-input.conf  --debug -v --create  identity.uri $OS_AUTH_URL identity.admin_password $OS_PASSWORD scenario.img_dir ~/tempest-dir/etc         identity.region regionOne    orchestration.stack_owner_role heat_stack_owner       --out ~/tempest-dir/etc/tempest.conf", "delta": "0:00:03.318630", "end": "2018-07-27 04:37:23.177658", "msg": "non-zero return code", "rc": 1, "start": "2018-07-27 04:37:19.859028", "stderr": "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import data-processing service filter: No module named data_processing.data_processing_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import baremetal-introspection service filter: No module named baremetal_introspection.baremetal_introspection_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import resource-optimization service filter: No module named resource_optimization.resource_optimization_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import application-catalog service filter: No module named application_catalog.application_catalog_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import container-infrastructure-management service filter: No module named container_infrastructure_management.container_infrastructure_management_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import search service filter: No module named search.search_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import dns service filter: No module named dns.dns_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import rating service filter: No module named rating.rating_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import operator-policy service filter: No module named operator_policy.operator_policy_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import shared-file-system service filter: No module named shared_file_system.shared_file_system_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import data-protection-orchestration service filter: No module named data_protection_orchestration.data_protection_orchestration_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import alarm service filter: No module named alarm.alarm_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import meter service filter: No module named meter.meter_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import event service filter: No module named event.event_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import application-deployment service filter: No module named application_deployment.application_deployment_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import multi-region-network-automation service filter: No module named multi_region_network_automation.multi_region_network_automation_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import application-container service filter: No module named application_container.application_container_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import root-cause-analysis service filter: No module named root_cause_analysis.root_cause_analysis_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import nfv-orchestration service filter: No module named nfv_orchestration.nfv_orchestration_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import backup service filter: No module named backup.backup_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import monitoring-logging service filter: No module named monitoring_logging.monitoring_logging_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import monitoring service filter: No module named monitoring.monitoring_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import monitoring-events service filter: No module named monitoring_events.monitoring_events_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import placement service filter: No module named placement.placement_service\n  ImportWarning)\n/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import reservation service filter: No module named reservation.reservation_service\n  ImportWarning)", "stderr_lines": ["/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import data-processing service filter: No module named data_processing.data_processing_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import baremetal-introspection service filter: No module named baremetal_introspection.baremetal_introspection_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import resource-optimization service filter: No module named resource_optimization.resource_optimization_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import application-catalog service filter: No module named application_catalog.application_catalog_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import container-infrastructure-management service filter: No module named container_infrastructure_management.container_infrastructure_management_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import search service filter: No module named search.search_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import dns service filter: No module named dns.dns_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import rating service filter: No module named rating.rating_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import operator-policy service filter: No module named operator_policy.operator_policy_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import shared-file-system service filter: No module named shared_file_system.shared_file_system_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import data-protection-orchestration service filter: No module named data_protection_orchestration.data_protection_orchestration_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import alarm service filter: No module named alarm.alarm_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import meter service filter: No module named meter.meter_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import event service filter: No module named event.event_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import application-deployment service filter: No module named application_deployment.application_deployment_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import multi-region-network-automation service filter: No module named multi_region_network_automation.multi_region_network_automation_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import application-container service filter: No module named application_container.application_container_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import root-cause-analysis service filter: No module named root_cause_analysis.root_cause_analysis_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import nfv-orchestration service filter: No module named nfv_orchestration.nfv_orchestration_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import backup service filter: No module named backup.backup_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import monitoring-logging service filter: No module named monitoring_logging.monitoring_logging_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import monitoring service filter: No module named monitoring.monitoring_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import monitoring-events service filter: No module named monitoring_events.monitoring_events_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import placement service filter: No module named placement.placement_service", "  ImportWarning)", "/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import reservation service filter: No module named reservation.reservation_service", "  ImportWarning)"], "stdout": "2018-07-27 04:37:20.668 3218 INFO tempest [-] Using tempest config file /etc/tempest/tempest.conf\u001b[00m\n2018-07-27 04:37:20.728 3218 INFO config_tempest.config_tempest [-] Reading defaults from file '/home/cloud-user/tempest_conf/etc/default-overrides.conf'\u001b[00m\n2018-07-27 04:37:20.730 3218 INFO config_tempest.config_tempest [-] Adding options from deployer-input file '/home/cloud-user/ir-tempest-deployer-input.conf'\u001b[00m\n2018-07-27 04:37:20.731 3218 DEBUG config_tempest.config_tempest [-] Setting [auth] tempest_roles = swiftoperator set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.732 3218 DEBUG config_tempest.config_tempest [-] Setting [compute] region = regionOne set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.732 3218 DEBUG config_tempest.config_tempest [-] Setting [compute-feature-enabled] console_output = True set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.732 3218 DEBUG config_tempest.config_tempest [-] Setting [compute-feature-enabled] attach_encrypted_volume = False set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.733 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] region = regionOne set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.733 3218 DEBUG config_tempest.config_tempest [-] Setting [image] region = regionOne set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.734 3218 DEBUG config_tempest.config_tempest [-] Setting [network] region = regionOne set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.734 3218 DEBUG config_tempest.config_tempest [-] Setting [object-storage] operator_role = swiftoperator set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.734 3218 DEBUG config_tempest.config_tempest [-] Setting [object-storage] region = regionOne set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.735 3218 DEBUG config_tempest.config_tempest [-] Setting [orchestration] stack_owner_role = swiftoperator set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.735 3218 DEBUG config_tempest.config_tempest [-] Setting [orchestration] region = regionOne set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.735 3218 DEBUG config_tempest.config_tempest [-] Setting [volume] backend1_name = tripleo_iscsi set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.735 3218 DEBUG config_tempest.config_tempest [-] Setting [volume] region = regionOne set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.736 3218 DEBUG config_tempest.config_tempest [-] Setting [volume-feature-enabled] bootable = true set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.736 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_username = admin set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.736 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_tenant_name = admin set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.737 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_password = ZXtDqHezCgK2pfcc3mK6DF7AD set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.737 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] uri = http://10.0.0.110:5000/v2.0 set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.737 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] uri = http://10.0.0.110:5000/v2.0 set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.738 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_password = ZXtDqHezCgK2pfcc3mK6DF7AD set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.738 3218 DEBUG config_tempest.config_tempest [-] Setting [scenario] img_dir = /home/cloud-user/tempest-dir/etc set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.738 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] region = regionOne set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.738 3218 DEBUG config_tempest.config_tempest [-] Setting [orchestration] stack_owner_role = heat_stack_owner set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.739 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] uri_v3 = http://10.0.0.110:5000/v3 set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:21.039 3218 INFO tempest.lib.common.rest_client [req-27450a8c-f978-4da9-a385-fde2a0f69fc7 ] Request (main): 200 POST http://10.0.0.110:5000/v2.0/tokens\u001b[00m\n2018-07-27 04:37:21.134 3218 INFO tempest.lib.common.rest_client [req-56d29cd8-9db6-4325-9f72-38d1185b6712 ] Request (main): 200 GET http://10.0.0.110:5000/v2.0/tenants 0.093s\u001b[00m\n2018-07-27 04:37:21.134 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_tenant_id = 89a605d8d15f4a03b752560fdc1b546b set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:23.084 3218 INFO config_tempest.config_tempest [-] Creating user 'demo' with tenant 'demo' and password 'secrete'\u001b[00m\n2018-07-27 04:37:23.112 3218 INFO tempest.lib.common.rest_client [req-fb9fc46e-7e91-4a3b-b692-77bbef5246d1 ] Request (main): 404 POST http://10.0.0.110:5000/v2.0/tenants 0.027s\u001b[00m\n2018-07-27 04:37:23.112 3218 CRITICAL tempest [-] Unhandled error: NotFound: Object not found\nDetails: {u'message': u'The resource could not be found.', u'code': 404, u'title': u'Not Found'}\n2018-07-27 04:37:23.112 3218 ERROR tempest Traceback (most recent call last):\n2018-07-27 04:37:23.112 3218 ERROR tempest   File \"/home/cloud-user/.virtualenvs/.tempest_conf/bin/discover-tempest-config\", line 11, in <module>\n2018-07-27 04:37:23.112 3218 ERROR tempest     sys.exit(main())\n2018-07-27 04:37:23.112 3218 ERROR tempest   File \"/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py\", line 192, in main\n2018-07-27 04:37:23.112 3218 ERROR tempest     conf, services)\n2018-07-27 04:37:23.112 3218 ERROR tempest   File \"/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py\", line 690, in create_tempest_users\n2018-07-27 04:37:23.112 3218 ERROR tempest     conf.get('identity', 'tenant_name'))\n2018-07-27 04:37:23.112 3218 ERROR tempest   File \"/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py\", line 750, in create_user_with_tenant\n2018-07-27 04:37:23.112 3218 ERROR tempest     description=tenant_description)\n2018-07-27 04:37:23.112 3218 ERROR tempest   File \"/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py\", line 377, in create_project\n2018-07-27 04:37:23.112 3218 ERROR tempest     self.client.create_tenant(name=name, description=description)\n2018-07-27 04:37:23.112 3218 ERROR tempest   File \"/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/tempest/lib/services/identity/v2/tenants_client.py\", line 32, in create_tenant\n2018-07-27 04:37:23.112 3218 ERROR tempest     resp, body = self.post('tenants', post_body)\n2018-07-27 04:37:23.112 3218 ERROR tempest   File \"/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/tempest/lib/common/rest_client.py\", line 279, in post\n2018-07-27 04:37:23.112 3218 ERROR tempest     return self.request('POST', url, extra_headers, headers, body, chunked)\n2018-07-27 04:37:23.112 3218 ERROR tempest   File \"/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/tempest/lib/common/rest_client.py\", line 668, in request\n2018-07-27 04:37:23.112 3218 ERROR tempest     self._error_checker(resp, resp_body)\n2018-07-27 04:37:23.112 3218 ERROR tempest   File \"/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/tempest/lib/common/rest_client.py\", line 774, in _error_checker\n2018-07-27 04:37:23.112 3218 ERROR tempest     raise exceptions.NotFound(resp_body, resp=resp)\n2018-07-27 04:37:23.112 3218 ERROR tempest NotFound: Object not found\n2018-07-27 04:37:23.112 3218 ERROR tempest Details: {u'message': u'The resource could not be found.', u'code': 404, u'title': u'Not Found'}\n2018-07-27 04:37:23.112 3218 ERROR tempest \u001b[00m", "stdout_lines": ["2018-07-27 04:37:20.668 3218 INFO tempest [-] Using tempest config file /etc/tempest/tempest.conf\u001b[00m", "2018-07-27 04:37:20.728 3218 INFO config_tempest.config_tempest [-] Reading defaults from file '/home/cloud-user/tempest_conf/etc/default-overrides.conf'\u001b[00m", "2018-07-27 04:37:20.730 3218 INFO config_tempest.config_tempest [-] Adding options from deployer-input file '/home/cloud-user/ir-tempest-deployer-input.conf'\u001b[00m", "2018-07-27 04:37:20.731 3218 DEBUG config_tempest.config_tempest [-] Setting [auth] tempest_roles = swiftoperator set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.732 3218 DEBUG config_tempest.config_tempest [-] Setting [compute] region = regionOne set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.732 3218 DEBUG config_tempest.config_tempest [-] Setting [compute-feature-enabled] console_output = True set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.732 3218 DEBUG config_tempest.config_tempest [-] Setting [compute-feature-enabled] attach_encrypted_volume = False set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.733 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] region = regionOne set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.733 3218 DEBUG config_tempest.config_tempest [-] Setting [image] region = regionOne set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.734 3218 DEBUG config_tempest.config_tempest [-] Setting [network] region = regionOne set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.734 3218 DEBUG config_tempest.config_tempest [-] Setting [object-storage] operator_role = swiftoperator set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.734 3218 DEBUG config_tempest.config_tempest [-] Setting [object-storage] region = regionOne set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.735 3218 DEBUG config_tempest.config_tempest [-] Setting [orchestration] stack_owner_role = swiftoperator set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.735 3218 DEBUG config_tempest.config_tempest [-] Setting [orchestration] region = regionOne set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.735 3218 DEBUG config_tempest.config_tempest [-] Setting [volume] backend1_name = tripleo_iscsi set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.735 3218 DEBUG config_tempest.config_tempest [-] Setting [volume] region = regionOne set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.736 3218 DEBUG config_tempest.config_tempest [-] Setting [volume-feature-enabled] bootable = true set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.736 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_username = admin set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.736 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_tenant_name = admin set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.737 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_password = ZXtDqHezCgK2pfcc3mK6DF7AD set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.737 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] uri = http://10.0.0.110:5000/v2.0 set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.737 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] uri = http://10.0.0.110:5000/v2.0 set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.738 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_password = ZXtDqHezCgK2pfcc3mK6DF7AD set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.738 3218 DEBUG config_tempest.config_tempest [-] Setting [scenario] img_dir = /home/cloud-user/tempest-dir/etc set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.738 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] region = regionOne set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.738 3218 DEBUG config_tempest.config_tempest [-] Setting [orchestration] stack_owner_role = heat_stack_owner set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.739 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] uri_v3 = http://10.0.0.110:5000/v3 set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:21.039 3218 INFO tempest.lib.common.rest_client [req-27450a8c-f978-4da9-a385-fde2a0f69fc7 ] Request (main): 200 POST http://10.0.0.110:5000/v2.0/tokens\u001b[00m", "2018-07-27 04:37:21.134 3218 INFO tempest.lib.common.rest_client [req-56d29cd8-9db6-4325-9f72-38d1185b6712 ] Request (main): 200 GET http://10.0.0.110:5000/v2.0/tenants 0.093s\u001b[00m", "2018-07-27 04:37:21.134 3218 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_tenant_id = 89a605d8d15f4a03b752560fdc1b546b set /home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:23.084 3218 INFO config_tempest.config_tempest [-] Creating user 'demo' with tenant 'demo' and password 'secrete'\u001b[00m", "2018-07-27 04:37:23.112 3218 INFO tempest.lib.common.rest_client [req-fb9fc46e-7e91-4a3b-b692-77bbef5246d1 ] Request (main): 404 POST http://10.0.0.110:5000/v2.0/tenants 0.027s\u001b[00m", "2018-07-27 04:37:23.112 3218 CRITICAL tempest [-] Unhandled error: NotFound: Object not found", "Details: {u'message': u'The resource could not be found.', u'code': 404, u'title': u'Not Found'}", "2018-07-27 04:37:23.112 3218 ERROR tempest Traceback (most recent call last):", "2018-07-27 04:37:23.112 3218 ERROR tempest   File \"/home/cloud-user/.virtualenvs/.tempest_conf/bin/discover-tempest-config\", line 11, in <module>", "2018-07-27 04:37:23.112 3218 ERROR tempest     sys.exit(main())", "2018-07-27 04:37:23.112 3218 ERROR tempest   File \"/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py\", line 192, in main", "2018-07-27 04:37:23.112 3218 ERROR tempest     conf, services)", "2018-07-27 04:37:23.112 3218 ERROR tempest   File \"/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py\", line 690, in create_tempest_users", "2018-07-27 04:37:23.112 3218 ERROR tempest     conf.get('identity', 'tenant_name'))", "2018-07-27 04:37:23.112 3218 ERROR tempest   File \"/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py\", line 750, in create_user_with_tenant", "2018-07-27 04:37:23.112 3218 ERROR tempest     description=tenant_description)", "2018-07-27 04:37:23.112 3218 ERROR tempest   File \"/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py\", line 377, in create_project", "2018-07-27 04:37:23.112 3218 ERROR tempest     self.client.create_tenant(name=name, description=description)", "2018-07-27 04:37:23.112 3218 ERROR tempest   File \"/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/tempest/lib/services/identity/v2/tenants_client.py\", line 32, in create_tenant", "2018-07-27 04:37:23.112 3218 ERROR tempest     resp, body = self.post('tenants', post_body)", "2018-07-27 04:37:23.112 3218 ERROR tempest   File \"/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/tempest/lib/common/rest_client.py\", line 279, in post", "2018-07-27 04:37:23.112 3218 ERROR tempest     return self.request('POST', url, extra_headers, headers, body, chunked)", "2018-07-27 04:37:23.112 3218 ERROR tempest   File \"/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/tempest/lib/common/rest_client.py\", line 668, in request", "2018-07-27 04:37:23.112 3218 ERROR tempest     self._error_checker(resp, resp_body)", "2018-07-27 04:37:23.112 3218 ERROR tempest   File \"/home/cloud-user/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/tempest/lib/common/rest_client.py\", line 774, in _error_checker", "2018-07-27 04:37:23.112 3218 ERROR tempest     raise exceptions.NotFound(resp_body, resp=resp)", "2018-07-27 04:37:23.112 3218 ERROR tempest NotFound: Object not found", "2018-07-27 04:37:23.112 3218 ERROR tempest Details: {u'message': u'The resource could not be found.', u'code': 404, u'title': u'Not Found'}", "2018-07-27 04:37:23.112 3218 ERROR tempest \u001b[00m"]}
fatal: [undercloud-0]: FAILED! => {"changed": true, "cmd": "test -e ~/.virtualenvs/.tempest_conf/bin/activate && source ~/.virtualenvs/.tempest_conf/bin/activate\n source ~/keystonerc\n discover-tempest-config  --deployer-input ~/ir-tempest-deployer-input.conf  --debug -v --create  identity.uri $OS_AUTH_URL identity.admin_password $OS_PASSWORD scenario.img_dir ~/tempest-dir/etc         identity.region regionOne    orchestration.stack_owner_role heat_stack_owner       --out ~/tempest-dir/etc/tempest.conf", "delta": "0:00:03.334994", "end": "2018-07-27 04:37:23.250742", "msg": "non-zero return code", "rc": 1, "start": "2018-07-27 04:37:19.915748", "stderr": "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import data-processing service filter: No module named data_processing.data_processing_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import baremetal-introspection service filter: No module named baremetal_introspection.baremetal_introspection_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import resource-optimization service filter: No module named resource_optimization.resource_optimization_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import application-catalog service filter: No module named application_catalog.application_catalog_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import container-infrastructure-management service filter: No module named container_infrastructure_management.container_infrastructure_management_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import search service filter: No module named search.search_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import dns service filter: No module named dns.dns_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import rating service filter: No module named rating.rating_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import operator-policy service filter: No module named operator_policy.operator_policy_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import shared-file-system service filter: No module named shared_file_system.shared_file_system_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import data-protection-orchestration service filter: No module named data_protection_orchestration.data_protection_orchestration_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import alarm service filter: No module named alarm.alarm_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import meter service filter: No module named meter.meter_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import event service filter: No module named event.event_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import application-deployment service filter: No module named application_deployment.application_deployment_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import multi-region-network-automation service filter: No module named multi_region_network_automation.multi_region_network_automation_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import application-container service filter: No module named application_container.application_container_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import root-cause-analysis service filter: No module named root_cause_analysis.root_cause_analysis_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import nfv-orchestration service filter: No module named nfv_orchestration.nfv_orchestration_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import backup service filter: No module named backup.backup_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import monitoring-logging service filter: No module named monitoring_logging.monitoring_logging_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import monitoring service filter: No module named monitoring.monitoring_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import monitoring-events service filter: No module named monitoring_events.monitoring_events_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import placement service filter: No module named placement.placement_service\n  ImportWarning)\n/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import reservation service filter: No module named reservation.reservation_service\n  ImportWarning)", "stderr_lines": ["/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import data-processing service filter: No module named data_processing.data_processing_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import baremetal-introspection service filter: No module named baremetal_introspection.baremetal_introspection_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import resource-optimization service filter: No module named resource_optimization.resource_optimization_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import application-catalog service filter: No module named application_catalog.application_catalog_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import container-infrastructure-management service filter: No module named container_infrastructure_management.container_infrastructure_management_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import search service filter: No module named search.search_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import dns service filter: No module named dns.dns_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import rating service filter: No module named rating.rating_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import operator-policy service filter: No module named operator_policy.operator_policy_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import shared-file-system service filter: No module named shared_file_system.shared_file_system_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import data-protection-orchestration service filter: No module named data_protection_orchestration.data_protection_orchestration_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import alarm service filter: No module named alarm.alarm_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import meter service filter: No module named meter.meter_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import event service filter: No module named event.event_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import application-deployment service filter: No module named application_deployment.application_deployment_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import multi-region-network-automation service filter: No module named multi_region_network_automation.multi_region_network_automation_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import application-container service filter: No module named application_container.application_container_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import root-cause-analysis service filter: No module named root_cause_analysis.root_cause_analysis_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import nfv-orchestration service filter: No module named nfv_orchestration.nfv_orchestration_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import backup service filter: No module named backup.backup_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import monitoring-logging service filter: No module named monitoring_logging.monitoring_logging_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import monitoring service filter: No module named monitoring.monitoring_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import monitoring-events service filter: No module named monitoring_events.monitoring_events_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import placement service filter: No module named placement.placement_service", "  ImportWarning)", "/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/openstack/_meta/connection.py:122: ImportWarning: Could not import reservation service filter: No module named reservation.reservation_service", "  ImportWarning)"], "stdout": "2018-07-27 04:37:20.784 20933 INFO tempest [-] Using tempest config file /etc/tempest/tempest.conf\u001b[00m\n2018-07-27 04:37:20.849 20933 INFO config_tempest.config_tempest [-] Reading defaults from file '/home/stack/tempest_conf/etc/default-overrides.conf'\u001b[00m\n2018-07-27 04:37:20.852 20933 INFO config_tempest.config_tempest [-] Adding options from deployer-input file '/home/stack/ir-tempest-deployer-input.conf'\u001b[00m\n2018-07-27 04:37:20.853 20933 DEBUG config_tempest.config_tempest [-] Setting [auth] tempest_roles = swiftoperator set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.854 20933 DEBUG config_tempest.config_tempest [-] Setting [compute] region = regionOne set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.854 20933 DEBUG config_tempest.config_tempest [-] Setting [compute-feature-enabled] console_output = True set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.854 20933 DEBUG config_tempest.config_tempest [-] Setting [compute-feature-enabled] attach_encrypted_volume = False set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.855 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] region = regionOne set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.855 20933 DEBUG config_tempest.config_tempest [-] Setting [image] region = regionOne set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.856 20933 DEBUG config_tempest.config_tempest [-] Setting [network] region = regionOne set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.856 20933 DEBUG config_tempest.config_tempest [-] Setting [object-storage] operator_role = swiftoperator set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.856 20933 DEBUG config_tempest.config_tempest [-] Setting [object-storage] region = regionOne set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.857 20933 DEBUG config_tempest.config_tempest [-] Setting [orchestration] stack_owner_role = swiftoperator set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.857 20933 DEBUG config_tempest.config_tempest [-] Setting [orchestration] region = regionOne set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.858 20933 DEBUG config_tempest.config_tempest [-] Setting [volume] backend1_name = tripleo_iscsi set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.858 20933 DEBUG config_tempest.config_tempest [-] Setting [volume] region = regionOne set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.858 20933 DEBUG config_tempest.config_tempest [-] Setting [volume-feature-enabled] bootable = true set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.859 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_username = admin set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.859 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_tenant_name = admin set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.860 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_password = ZXtDqHezCgK2pfcc3mK6DF7AD set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.860 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] uri = http://10.0.0.110:5000/v2.0 set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.860 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] uri = http://10.0.0.110:5000/v2.0 set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.861 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_password = ZXtDqHezCgK2pfcc3mK6DF7AD set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.861 20933 DEBUG config_tempest.config_tempest [-] Setting [scenario] img_dir = /home/stack/tempest-dir/etc set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.861 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] region = regionOne set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.862 20933 DEBUG config_tempest.config_tempest [-] Setting [orchestration] stack_owner_role = heat_stack_owner set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:20.862 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] uri_v3 = http://10.0.0.110:5000/v3 set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:21.157 20933 INFO tempest.lib.common.rest_client [req-d94dee11-4e4d-489e-8a80-340542263297 ] Request (main): 200 POST http://10.0.0.110:5000/v2.0/tokens\u001b[00m\n2018-07-27 04:37:21.251 20933 INFO tempest.lib.common.rest_client [req-9d3c259a-7120-419b-b59a-f14d4bb702cd ] Request (main): 200 GET http://10.0.0.110:5000/v2.0/tenants 0.092s\u001b[00m\n2018-07-27 04:37:21.251 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_tenant_id = 89a605d8d15f4a03b752560fdc1b546b set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m\n2018-07-27 04:37:23.168 20933 INFO config_tempest.config_tempest [-] Creating user 'demo' with tenant 'demo' and password 'secrete'\u001b[00m\n2018-07-27 04:37:23.196 20933 INFO tempest.lib.common.rest_client [req-3254bcf8-c478-485b-908b-5cdaa1ffeee4 ] Request (main): 404 POST http://10.0.0.110:5000/v2.0/tenants 0.027s\u001b[00m\n2018-07-27 04:37:23.197 20933 CRITICAL tempest [-] Unhandled error: NotFound: Object not found\nDetails: {u'message': u'The resource could not be found.', u'code': 404, u'title': u'Not Found'}\n2018-07-27 04:37:23.197 20933 ERROR tempest Traceback (most recent call last):\n2018-07-27 04:37:23.197 20933 ERROR tempest   File \"/home/stack/.virtualenvs/.tempest_conf/bin/discover-tempest-config\", line 11, in <module>\n2018-07-27 04:37:23.197 20933 ERROR tempest     sys.exit(main())\n2018-07-27 04:37:23.197 20933 ERROR tempest   File \"/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py\", line 192, in main\n2018-07-27 04:37:23.197 20933 ERROR tempest     conf, services)\n2018-07-27 04:37:23.197 20933 ERROR tempest   File \"/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py\", line 690, in create_tempest_users\n2018-07-27 04:37:23.197 20933 ERROR tempest     conf.get('identity', 'tenant_name'))\n2018-07-27 04:37:23.197 20933 ERROR tempest   File \"/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py\", line 750, in create_user_with_tenant\n2018-07-27 04:37:23.197 20933 ERROR tempest     description=tenant_description)\n2018-07-27 04:37:23.197 20933 ERROR tempest   File \"/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py\", line 377, in create_project\n2018-07-27 04:37:23.197 20933 ERROR tempest     self.client.create_tenant(name=name, description=description)\n2018-07-27 04:37:23.197 20933 ERROR tempest   File \"/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/tempest/lib/services/identity/v2/tenants_client.py\", line 32, in create_tenant\n2018-07-27 04:37:23.197 20933 ERROR tempest     resp, body = self.post('tenants', post_body)\n2018-07-27 04:37:23.197 20933 ERROR tempest   File \"/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/tempest/lib/common/rest_client.py\", line 279, in post\n2018-07-27 04:37:23.197 20933 ERROR tempest     return self.request('POST', url, extra_headers, headers, body, chunked)\n2018-07-27 04:37:23.197 20933 ERROR tempest   File \"/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/tempest/lib/common/rest_client.py\", line 668, in request\n2018-07-27 04:37:23.197 20933 ERROR tempest     self._error_checker(resp, resp_body)\n2018-07-27 04:37:23.197 20933 ERROR tempest   File \"/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/tempest/lib/common/rest_client.py\", line 774, in _error_checker\n2018-07-27 04:37:23.197 20933 ERROR tempest     raise exceptions.NotFound(resp_body, resp=resp)\n2018-07-27 04:37:23.197 20933 ERROR tempest NotFound: Object not found\n2018-07-27 04:37:23.197 20933 ERROR tempest Details: {u'message': u'The resource could not be found.', u'code': 404, u'title': u'Not Found'}\n2018-07-27 04:37:23.197 20933 ERROR tempest \u001b[00m", "stdout_lines": ["2018-07-27 04:37:20.784 20933 INFO tempest [-] Using tempest config file /etc/tempest/tempest.conf\u001b[00m", "2018-07-27 04:37:20.849 20933 INFO config_tempest.config_tempest [-] Reading defaults from file '/home/stack/tempest_conf/etc/default-overrides.conf'\u001b[00m", "2018-07-27 04:37:20.852 20933 INFO config_tempest.config_tempest [-] Adding options from deployer-input file '/home/stack/ir-tempest-deployer-input.conf'\u001b[00m", "2018-07-27 04:37:20.853 20933 DEBUG config_tempest.config_tempest [-] Setting [auth] tempest_roles = swiftoperator set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.854 20933 DEBUG config_tempest.config_tempest [-] Setting [compute] region = regionOne set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.854 20933 DEBUG config_tempest.config_tempest [-] Setting [compute-feature-enabled] console_output = True set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.854 20933 DEBUG config_tempest.config_tempest [-] Setting [compute-feature-enabled] attach_encrypted_volume = False set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.855 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] region = regionOne set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.855 20933 DEBUG config_tempest.config_tempest [-] Setting [image] region = regionOne set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.856 20933 DEBUG config_tempest.config_tempest [-] Setting [network] region = regionOne set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.856 20933 DEBUG config_tempest.config_tempest [-] Setting [object-storage] operator_role = swiftoperator set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.856 20933 DEBUG config_tempest.config_tempest [-] Setting [object-storage] region = regionOne set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.857 20933 DEBUG config_tempest.config_tempest [-] Setting [orchestration] stack_owner_role = swiftoperator set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.857 20933 DEBUG config_tempest.config_tempest [-] Setting [orchestration] region = regionOne set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.858 20933 DEBUG config_tempest.config_tempest [-] Setting [volume] backend1_name = tripleo_iscsi set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.858 20933 DEBUG config_tempest.config_tempest [-] Setting [volume] region = regionOne set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.858 20933 DEBUG config_tempest.config_tempest [-] Setting [volume-feature-enabled] bootable = true set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.859 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_username = admin set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.859 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_tenant_name = admin set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.860 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_password = ZXtDqHezCgK2pfcc3mK6DF7AD set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.860 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] uri = http://10.0.0.110:5000/v2.0 set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.860 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] uri = http://10.0.0.110:5000/v2.0 set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.861 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_password = ZXtDqHezCgK2pfcc3mK6DF7AD set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.861 20933 DEBUG config_tempest.config_tempest [-] Setting [scenario] img_dir = /home/stack/tempest-dir/etc set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.861 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] region = regionOne set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.862 20933 DEBUG config_tempest.config_tempest [-] Setting [orchestration] stack_owner_role = heat_stack_owner set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:20.862 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] uri_v3 = http://10.0.0.110:5000/v3 set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:21.157 20933 INFO tempest.lib.common.rest_client [req-d94dee11-4e4d-489e-8a80-340542263297 ] Request (main): 200 POST http://10.0.0.110:5000/v2.0/tokens\u001b[00m", "2018-07-27 04:37:21.251 20933 INFO tempest.lib.common.rest_client [req-9d3c259a-7120-419b-b59a-f14d4bb702cd ] Request (main): 200 GET http://10.0.0.110:5000/v2.0/tenants 0.092s\u001b[00m", "2018-07-27 04:37:21.251 20933 DEBUG config_tempest.config_tempest [-] Setting [identity] admin_tenant_id = 89a605d8d15f4a03b752560fdc1b546b set /home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py:648\u001b[00m", "2018-07-27 04:37:23.168 20933 INFO config_tempest.config_tempest [-] Creating user 'demo' with tenant 'demo' and password 'secrete'\u001b[00m", "2018-07-27 04:37:23.196 20933 INFO tempest.lib.common.rest_client [req-3254bcf8-c478-485b-908b-5cdaa1ffeee4 ] Request (main): 404 POST http://10.0.0.110:5000/v2.0/tenants 0.027s\u001b[00m", "2018-07-27 04:37:23.197 20933 CRITICAL tempest [-] Unhandled error: NotFound: Object not found", "Details: {u'message': u'The resource could not be found.', u'code': 404, u'title': u'Not Found'}", "2018-07-27 04:37:23.197 20933 ERROR tempest Traceback (most recent call last):", "2018-07-27 04:37:23.197 20933 ERROR tempest   File \"/home/stack/.virtualenvs/.tempest_conf/bin/discover-tempest-config\", line 11, in <module>", "2018-07-27 04:37:23.197 20933 ERROR tempest     sys.exit(main())", "2018-07-27 04:37:23.197 20933 ERROR tempest   File \"/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py\", line 192, in main", "2018-07-27 04:37:23.197 20933 ERROR tempest     conf, services)", "2018-07-27 04:37:23.197 20933 ERROR tempest   File \"/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py\", line 690, in create_tempest_users", "2018-07-27 04:37:23.197 20933 ERROR tempest     conf.get('identity', 'tenant_name'))", "2018-07-27 04:37:23.197 20933 ERROR tempest   File \"/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py\", line 750, in create_user_with_tenant", "2018-07-27 04:37:23.197 20933 ERROR tempest     description=tenant_description)", "2018-07-27 04:37:23.197 20933 ERROR tempest   File \"/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/config_tempest/config_tempest.py\", line 377, in create_project", "2018-07-27 04:37:23.197 20933 ERROR tempest     self.client.create_tenant(name=name, description=description)", "2018-07-27 04:37:23.197 20933 ERROR tempest   File \"/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/tempest/lib/services/identity/v2/tenants_client.py\", line 32, in create_tenant", "2018-07-27 04:37:23.197 20933 ERROR tempest     resp, body = self.post('tenants', post_body)", "2018-07-27 04:37:23.197 20933 ERROR tempest   File \"/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/tempest/lib/common/rest_client.py\", line 279, in post", "2018-07-27 04:37:23.197 20933 ERROR tempest     return self.request('POST', url, extra_headers, headers, body, chunked)", "2018-07-27 04:37:23.197 20933 ERROR tempest   File \"/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/tempest/lib/common/rest_client.py\", line 668, in request", "2018-07-27 04:37:23.197 20933 ERROR tempest     self._error_checker(resp, resp_body)", "2018-07-27 04:37:23.197 20933 ERROR tempest   File \"/home/stack/.virtualenvs/.tempest_conf/lib/python2.7/site-packages/tempest/lib/common/rest_client.py\", line 774, in _error_checker", "2018-07-27 04:37:23.197 20933 ERROR tempest     raise exceptions.NotFound(resp_body, resp=resp)", "2018-07-27 04:37:23.197 20933 ERROR tempest NotFound: Object not found", "2018-07-27 04:37:23.197 20933 ERROR tempest Details: {u'message': u'The resource could not be found.', u'code': 404, u'title': u'Not Found'}", "2018-07-27 04:37:23.197 20933 ERROR tempest \u001b[00m"]}
rusichen commented 6 years ago

Hi, Thanks for created issue. Need to enable additional repositories, right now i'm working on fix, as it'll be ready i add you to reviewers.

rusichen commented 6 years ago

Hi @FedericoRessi , By default we execute tempest on undercloud host and in your log you can find it [undercloud-0]. The tester-0 host is mainly used to prepare and execute some tests manually, that's why there is no any pre-defined repositories and so on. The reason why tempest is running on both hosts [undercloud-0] and [tester-0], because hosts are in the same group called [tester], as quick solution you can re-deploy your environment without tester:1 host in topology --topology-nodes undercloud:1,controller:1,compute:2 or update inventory file and remove tester-0 host from tester group and re-run tempest plugin. Inventory file path - INFRARED_DIR/.workspace/active/hosts, so it should be like this:

[tester]                                                                                                                          
undercloud-0

If you still need to run tempest on tester-0 host, then you'll need to add rhos-repositories. Please let me know, i'll share commands with you.

Thanks!

FedericoRessi commented 6 years ago

How can I add rhos-repositories?

rusichen commented 6 years ago

@FedericoRessi , Please execute following commands on tester-0 host to add rhos repos for OSP10, then you can find there openstack-tempest package:

curl -k -L -O https://url.corp.redhat.com/rhos-release-latest-rpm
sudo rpm -i rhos-release-latest-rpm
sudo rhos-release 10

Thanks!

FedericoRessi commented 6 years ago

Hello. I finally redeployed my cloud with OSP-13 from scratch removing tester node and I re-executed infrared tempest command as below after realizing there where still some missing RPMs on undercloud machine.

infrared tempest \
  --openstack-installer tripleo \
  --openstack-version 13 \
  --mode normal \
  --packages gcc,python-devel \
  --pip-packages setuptools>=30.0.0 \
  --plugin https://git.openstack.org/openstack/neutron-tempest-plugin \
  --results-formats junitxml,html \
  --tests all

I realized that the plugin is being installed on the system instead of a virtualenv and this is not quite good because then I saw some version incompatibility with other installed packages. :-(

Anyway this is another issue.

rusichen commented 6 years ago

Hi @FedericoRessi ,plugin is being installed on the system instead of a virtualenv - yes, that's right when you use:

Thanks!

FedericoRessi commented 6 years ago

I think all problems I spotted can be workaround by knowing better infrared-tempest limitations and behavior. Please think about improving documentation with information you provided me here so that other people would experience the same troubles as me. Thank you very much.