Closed am-agrawa closed 1 year ago
Looks like an intermittent issue. The test case has passed when run locally. OCP 4.8.0-0.nightly-2022-06-24-002737 OCS ocs-operator.v4.8.13
(venv) [amagrawa@amagrawa ocs-ci]$ run-ci -m tier1 --cluster-path /home/amagrawa/clusterpath tests/ui/test_validation_ui.py --dev-mode --cluster-name jnk-pr6046-b2994 --ocp-version 4.8 --ocs-version 4.8
Failed to fetch auth.yaml from ocs-ci-data
(Running with --headless on Linux. Use --headed or --gui to override.)
=================================================================== test session starts ===================================================================
platform linux -- Python 3.8.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.1
rootdir: /home/amagrawa/Downloads/Work/ocs-ci, configfile: pytest.ini
plugins: metadata-1.11.0, html-3.1.1, ordering-0.6, marker-bugzilla-0.9.4, logger-0.5.1, flaky-3.7.0, forked-1.3.0, xdist-2.3.0, rerunfailures-10.1, seleniumbase-1.63.17, cov-3.0.0, repeat-0.9.1, reportportal-1.10.3
collecting ...
------------------------------------------------------------------- live log collection -------------------------------------------------------------------
23:58:34 - MainThread - ocs_ci.utility.utils - INFO - Executing command: oc get clusterversion -n openshift-storage -o yaml
23:58:36 - MainThread - tests.conftest - INFO - Test:
tests/ui/test_validation_ui.py::TestUserInterfaceValidation::test_dashboard_validation_ui --------------------------------------------------------------------- live log setup ---------------------------------------------------------------------- 23:58:36 - MainThread - ocs_ci.utility.utils - INFO - testrun_name: OCS4-8-Downstream-OCP4-8-AWS-IPI-1AZ-RHCOS-3M-3W-tier1 23:58:36 - MainThread - ocs_ci.utility.utils - INFO - Retrieving the authentication config dictionary 23:58:36 - MainThread - ocs_ci.utility.utils - INFO - Executing command: oc -n openshift-storage get pods -o name 23:58:40 - MainThread - ocs_ci.ocs.utils - INFO - pod name match found appending rook-ceph-tools-7b69b4d875-bmprc 23:58:40 - MainThread - ocs_ci.ocs.utils - INFO - Ceph toolbox already exists, skipping 23:58:40 - MainThread - tests.conftest - INFO - All logs located at /tmp/ocs-ci-logs-1656527304 23:58:41 - MainThread - ocs_ci.utility.utils - INFO - Executing command: /home/amagrawa/Downloads/Work/ocs-ci/bin/oc version --client -o json 23:58:41 - MainThread - ocs_ci.utility.utils - INFO - Existing client version (4.11.0-0.nightly-2022-06-28-160049) does not match configured version (4.8.0-0.nightly-2022-06-29-080300). 23:58:41 - MainThread - ocs_ci.utility.utils - INFO - Downloading openshift client (4.8.0-0.nightly-2022-06-29-080300). 23:59:12 - MainThread - ocs_ci.utility.utils - INFO - Executing command: tar xzvf openshift-client.tar.gz oc kubectl 23:59:13 - MainThread - ocs_ci.utility.utils - INFO - Executing command: /home/amagrawa/Downloads/Work/ocs-ci/bin/oc version --client 23:59:13 - MainThread - ocs_ci.utility.utils - INFO - Deleted backup binaries. 23:59:13 - MainThread - ocs_ci.utility.utils - INFO - OpenShift Client version: Client Version: 4.8.0-0.nightly-2022-06-29-080300
23:59:13 - MainThread - ocs_ci.utility.utils - INFO - Executing command: oc -n openshift-storage get csv -n openshift-storage -o yaml 23:59:16 - MainThread - tests.conftest - INFO - Skipping version reporting for development mode. 23:59:16 - MainThread - tests.conftest - INFO - PagerDuty service is not created because platform from ['openshiftdedicated', 'rosa'] is not used 23:59:16 - MainThread - ocs_ci.utility.utils - INFO - testrun_name: OCS4-8-Downstream-OCP4-8-AWS-IPI-1AZ-RHCOS-3M-3W-tier1 23:59:16 - MainThread - ocs_ci.ocs.ocp - INFO - Get URL of OCP console 23:59:16 - MainThread - ocs_ci.utility.utils - INFO - Executing command: oc -n openshift-storage get consoles.config.openshift.io cluster -ojsonpath='{.status.consoleURL}' 23:59:21 - MainThread - ocs_ci.ocs.ocp - INFO - OCP URL: https://console-openshift-console.apps.srozen7-jun28-ui.qe.rh-ocs.com 23:59:21 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Get password of OCP console 23:59:21 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - chrome browser
[WDM] - Current google-chrome version is 101.0.4951 23:59:21 - MainThread - WDM - INFO - Current google-chrome version is 101.0.4951 [WDM] - Get LATEST driver version for 101.0.4951 23:59:21 - MainThread - WDM - INFO - Get LATEST driver version for 101.0.4951 [WDM] - Driver [/home/amagrawa/.wdm/drivers/chromedriver/linux64/101.0.4951.41/chromedriver] found in cache 23:59:22 - MainThread - WDM - INFO - Driver [/home/amagrawa/.wdm/drivers/chromedriver/linux64/101.0.4951.41/chromedriver] found in cache 23:59:50 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating screenshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-29T23-59-50.518471.png 00:00:05 - MainThread - tests.conftest - INFO - Skipping health checks for development mode 00:00:05 - MainThread - tests.conftest - INFO - Skipping alert check for development mode ---------------------------------------------------------------------- live log call ---------------------------------------------------------------------- 00:00:05 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - screenshots pictures:/tmp/screenshots_ui_1656527304/test_dashboard_validation_ui 00:00:05 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Navigate to Overview Page 00:00:21 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating snapshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-00-21.230435.png 00:00:22 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - verify ['Total Reads', 'Total Writes'] exist on object_service 00:00:26 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Navigate to Overview Page 00:00:27 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating snapshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-00-27.441455.png 00:00:28 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - verify ['IOPS', 'Latency', 'Throughput', 'Recovery', 'Utilization', 'Used Capacity Breakdown', 'Raw Capacity'] exist on persistent_storage 00:00:28 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Navigate to Installed Operators Page 00:00:33 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - page not loaded yet: https://console-openshift-console.apps.srozen7-jun28-ui.qe.rh-ocs.com/k8s/all-namespaces/operators.coreos.com~v1alpha1~ClusterServiceVersion 00:00:38 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - page not loaded yet: https://console-openshift-console.apps.srozen7-jun28-ui.qe.rh-ocs.com/k8s/all-namespaces/operators.coreos.com~v1alpha1~ClusterServiceVersion 00:00:43 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - page loaded: https://console-openshift-console.apps.srozen7-jun28-ui.qe.rh-ocs.com/k8s/all-namespaces/operators.coreos.com~v1alpha1~ClusterServiceVersion 00:00:43 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - Search OCS operator installed 00:00:44 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - Click on ocs operator on Installed Operators 00:00:45 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating snapshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-00-45.048422.png 00:00:45 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - Verify Details tab on OCS operator 00:00:45 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - verify ['Description', 'Succeeded', 'openshift-storage'] exist on details_tab 00:00:47 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - Verify Subscription tab on OCS operator 00:00:48 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating snapshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-00-48.459426.png 00:00:49 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - verify ['Healthy', 'openshift-storage'] exist on subscription_tab 00:00:49 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - Verify All instances tab on OCS operator 00:00:50 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating snapshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-00-50.295424.png 00:00:51 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - verify ['Phase', 'Ready', 'Status'] exist on all_instances_tab 00:00:52 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - Verify Storage Cluster tab on OCS operator 00:00:53 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating snapshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-00-53.065460.png 00:00:53 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - verify ['Phase', 'Ready', 'Status'] exist on storage_cluster_tab 00:00:53 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - Verify Backing Store tab on OCS operator 00:00:54 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating snapshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-00-54.895425.png 00:00:55 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - verify ['Phase', 'Ready', 'Status'] exist on backing_store_tab 00:00:56 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - Verify Bucket Class tab on OCS operator 00:00:57 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating snapshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-00-57.251468.png 00:00:57 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - verify ['Phase', 'Ready', 'Status'] exist on bucket_class_tab 00:00:59 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating snapshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-00-59.464452.png PASSED -------------------------------------------------------------------- live log teardown -------------------------------------------------------------------- 00:01:00 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Close browser 00:01:01 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating screenshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-01-01.138459.png
==================================================================== warnings summary ===================================================================== tests/ui/test_validation_ui.py::TestUserInterfaceValidation::test_dashboard_validation_ui /home/amagrawa/Downloads/Work/ocs-ci/venv/lib64/python3.8/site-packages/cryptography/hazmat/backends/openssl/x509.py:14: CryptographyDeprecationWarning: This version of cryptography contains a temporary pyOpenSSL fallback path. Upgrade pyOpenSSL now. warnings.warn(
-- Docs: https://docs.pytest.org/en/stable/warnings.html ======================================================== 1 passed, 1 warning in 147.18s (0:02:27) =========================================================
Failed again- Run ID: 1678742237 Raw capacity could be seen here- hhttps://url.corp.redhat.com/
also, Run ID: 1679099109 Run ID: 1680305295 Run ID: 1680740984
"Used Capacity Breakdown", "Raw Capacity" are now "Used capacity breakdown" and "Raw capacity". Function ocs_ci/ocs/ui/base_ui.py::BaseUI::check_element_text is case sensitive
"Used Capacity Breakdown", "Raw Capacity" are now "Used capacity breakdown" and "Raw capacity". Function ocs_ci/ocs/ui/base_ui.py::BaseUI::check_element_text is case sensitive
Great catch @DanielOsypenko, but I wonder why the above validation passed for me when I was tested it locally?
it passed on Jun 29, 2022. It might be that the texts were still all starting from upper case on OCP 4.8.0-0.nightly-2022-06-24-002737.
New text links are from 1678742237 run which is 11 month later.
regarding 1649849066 the Raw Capacity fell out of visibility, bellow the screen, something happened there with layout. http://magna002.ceph.redhat.com/ocsci-jenkins/openshift-clusters/j-103ai3c33-uo/j-103ai3c33-uo_20220413T083559/logs/screenshots_ui_1649849066/test_dashboard_validation_ui/2022-04-13T17-30-22.942697.png now that does not happen
it passed on Jun 29, 2022. It might be that the texts were still all starting from upper case on OCP 4.8.0-0.nightly-2022-06-24-002737. New text links are from 1678742237 run which is 11 month later.
regarding 1649849066 the Raw Capacity fell out of visibility, bellow the screen, something happened there with layout. http://magna002.ceph.redhat.com/ocsci-jenkins/openshift-clusters/j-103ai3c33-uo/j-103ai3c33-uo_20220413T083559/logs/screenshots_ui_1649849066/test_dashboard_validation_ui/2022-04-13T17-30-22.942697.png now that does not happen
Sorry didn't get you. I can see "Raw capacity" in this screenshot.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 30 days if no further activity occurs.
This issue has been automatically closed due to inactivity. Please re-open if this still requires investigation.
The failure is seen in
BUILD ID: 4.8.10-2 RUN ID: 1649848448
and Run1649849066
Test- tests/ui/test_validation_ui.py::TestUserInterfaceValidation::test_dashboard_validation_ui
Raw Capacity string can be seen in the screenshot collected during the run.