red-hat-storage / ocs-ci

https://ocs-ci.readthedocs.io/en/latest/
MIT License
108 stars 166 forks source link

Update the code to search for `Raw Capacity` string on Persistent Storage #5754

Closed am-agrawa closed 1 year ago

am-agrawa commented 2 years ago

The failure is seen in BUILD ID: 4.8.10-2 RUN ID: 1649848448 and Run 1649849066

Test- tests/ui/test_validation_ui.py::TestUserInterfaceValidation::test_dashboard_validation_ui

Raw Capacity string can be seen in the screenshot collected during the run.

am-agrawa commented 2 years ago

Looks like an intermittent issue. The test case has passed when run locally. OCP 4.8.0-0.nightly-2022-06-24-002737 OCS ocs-operator.v4.8.13

(venv) [amagrawa@amagrawa ocs-ci]$ run-ci -m tier1 --cluster-path /home/amagrawa/clusterpath tests/ui/test_validation_ui.py --dev-mode --cluster-name jnk-pr6046-b2994 --ocp-version 4.8 --ocs-version 4.8 Failed to fetch auth.yaml from ocs-ci-data (Running with --headless on Linux. Use --headed or --gui to override.) =================================================================== test session starts =================================================================== platform linux -- Python 3.8.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.1 rootdir: /home/amagrawa/Downloads/Work/ocs-ci, configfile: pytest.ini plugins: metadata-1.11.0, html-3.1.1, ordering-0.6, marker-bugzilla-0.9.4, logger-0.5.1, flaky-3.7.0, forked-1.3.0, xdist-2.3.0, rerunfailures-10.1, seleniumbase-1.63.17, cov-3.0.0, repeat-0.9.1, reportportal-1.10.3 collecting ... ------------------------------------------------------------------- live log collection ------------------------------------------------------------------- 23:58:34 - MainThread - ocs_ci.utility.utils - INFO - Executing command: oc get clusterversion -n openshift-storage -o yaml 23:58:36 - MainThread - tests.conftest - INFO - Test: will be skipped due to ('<4.9',) collected 2 items

tests/ui/test_validation_ui.py::TestUserInterfaceValidation::test_dashboard_validation_ui --------------------------------------------------------------------- live log setup ---------------------------------------------------------------------- 23:58:36 - MainThread - ocs_ci.utility.utils - INFO - testrun_name: OCS4-8-Downstream-OCP4-8-AWS-IPI-1AZ-RHCOS-3M-3W-tier1 23:58:36 - MainThread - ocs_ci.utility.utils - INFO - Retrieving the authentication config dictionary 23:58:36 - MainThread - ocs_ci.utility.utils - INFO - Executing command: oc -n openshift-storage get pods -o name 23:58:40 - MainThread - ocs_ci.ocs.utils - INFO - pod name match found appending rook-ceph-tools-7b69b4d875-bmprc 23:58:40 - MainThread - ocs_ci.ocs.utils - INFO - Ceph toolbox already exists, skipping 23:58:40 - MainThread - tests.conftest - INFO - All logs located at /tmp/ocs-ci-logs-1656527304 23:58:41 - MainThread - ocs_ci.utility.utils - INFO - Executing command: /home/amagrawa/Downloads/Work/ocs-ci/bin/oc version --client -o json 23:58:41 - MainThread - ocs_ci.utility.utils - INFO - Existing client version (4.11.0-0.nightly-2022-06-28-160049) does not match configured version (4.8.0-0.nightly-2022-06-29-080300). 23:58:41 - MainThread - ocs_ci.utility.utils - INFO - Downloading openshift client (4.8.0-0.nightly-2022-06-29-080300). 23:59:12 - MainThread - ocs_ci.utility.utils - INFO - Executing command: tar xzvf openshift-client.tar.gz oc kubectl 23:59:13 - MainThread - ocs_ci.utility.utils - INFO - Executing command: /home/amagrawa/Downloads/Work/ocs-ci/bin/oc version --client 23:59:13 - MainThread - ocs_ci.utility.utils - INFO - Deleted backup binaries. 23:59:13 - MainThread - ocs_ci.utility.utils - INFO - OpenShift Client version: Client Version: 4.8.0-0.nightly-2022-06-29-080300

23:59:13 - MainThread - ocs_ci.utility.utils - INFO - Executing command: oc -n openshift-storage get csv -n openshift-storage -o yaml 23:59:16 - MainThread - tests.conftest - INFO - Skipping version reporting for development mode. 23:59:16 - MainThread - tests.conftest - INFO - PagerDuty service is not created because platform from ['openshiftdedicated', 'rosa'] is not used 23:59:16 - MainThread - ocs_ci.utility.utils - INFO - testrun_name: OCS4-8-Downstream-OCP4-8-AWS-IPI-1AZ-RHCOS-3M-3W-tier1 23:59:16 - MainThread - ocs_ci.ocs.ocp - INFO - Get URL of OCP console 23:59:16 - MainThread - ocs_ci.utility.utils - INFO - Executing command: oc -n openshift-storage get consoles.config.openshift.io cluster -ojsonpath='{.status.consoleURL}' 23:59:21 - MainThread - ocs_ci.ocs.ocp - INFO - OCP URL: https://console-openshift-console.apps.srozen7-jun28-ui.qe.rh-ocs.com 23:59:21 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Get password of OCP console 23:59:21 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - chrome browser

[WDM] - Current google-chrome version is 101.0.4951 23:59:21 - MainThread - WDM - INFO - Current google-chrome version is 101.0.4951 [WDM] - Get LATEST driver version for 101.0.4951 23:59:21 - MainThread - WDM - INFO - Get LATEST driver version for 101.0.4951 [WDM] - Driver [/home/amagrawa/.wdm/drivers/chromedriver/linux64/101.0.4951.41/chromedriver] found in cache 23:59:22 - MainThread - WDM - INFO - Driver [/home/amagrawa/.wdm/drivers/chromedriver/linux64/101.0.4951.41/chromedriver] found in cache 23:59:50 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating screenshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-29T23-59-50.518471.png 00:00:05 - MainThread - tests.conftest - INFO - Skipping health checks for development mode 00:00:05 - MainThread - tests.conftest - INFO - Skipping alert check for development mode ---------------------------------------------------------------------- live log call ---------------------------------------------------------------------- 00:00:05 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - screenshots pictures:/tmp/screenshots_ui_1656527304/test_dashboard_validation_ui 00:00:05 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Navigate to Overview Page 00:00:21 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating snapshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-00-21.230435.png 00:00:22 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - verify ['Total Reads', 'Total Writes'] exist on object_service 00:00:26 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Navigate to Overview Page 00:00:27 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating snapshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-00-27.441455.png 00:00:28 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - verify ['IOPS', 'Latency', 'Throughput', 'Recovery', 'Utilization', 'Used Capacity Breakdown', 'Raw Capacity'] exist on persistent_storage 00:00:28 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Navigate to Installed Operators Page 00:00:33 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - page not loaded yet: https://console-openshift-console.apps.srozen7-jun28-ui.qe.rh-ocs.com/k8s/all-namespaces/operators.coreos.com~v1alpha1~ClusterServiceVersion 00:00:38 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - page not loaded yet: https://console-openshift-console.apps.srozen7-jun28-ui.qe.rh-ocs.com/k8s/all-namespaces/operators.coreos.com~v1alpha1~ClusterServiceVersion 00:00:43 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - page loaded: https://console-openshift-console.apps.srozen7-jun28-ui.qe.rh-ocs.com/k8s/all-namespaces/operators.coreos.com~v1alpha1~ClusterServiceVersion 00:00:43 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - Search OCS operator installed 00:00:44 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - Click on ocs operator on Installed Operators 00:00:45 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating snapshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-00-45.048422.png 00:00:45 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - Verify Details tab on OCS operator 00:00:45 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - verify ['Description', 'Succeeded', 'openshift-storage'] exist on details_tab 00:00:47 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - Verify Subscription tab on OCS operator 00:00:48 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating snapshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-00-48.459426.png 00:00:49 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - verify ['Healthy', 'openshift-storage'] exist on subscription_tab 00:00:49 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - Verify All instances tab on OCS operator 00:00:50 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating snapshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-00-50.295424.png 00:00:51 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - verify ['Phase', 'Ready', 'Status'] exist on all_instances_tab 00:00:52 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - Verify Storage Cluster tab on OCS operator 00:00:53 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating snapshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-00-53.065460.png 00:00:53 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - verify ['Phase', 'Ready', 'Status'] exist on storage_cluster_tab 00:00:53 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - Verify Backing Store tab on OCS operator 00:00:54 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating snapshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-00-54.895425.png 00:00:55 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - verify ['Phase', 'Ready', 'Status'] exist on backing_store_tab 00:00:56 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - Verify Bucket Class tab on OCS operator 00:00:57 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating snapshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-00-57.251468.png 00:00:57 - MainThread - ocs_ci.ocs.ui.validation_ui - INFO - verify ['Phase', 'Ready', 'Status'] exist on bucket_class_tab 00:00:59 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating snapshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-00-59.464452.png PASSED -------------------------------------------------------------------- live log teardown -------------------------------------------------------------------- 00:01:00 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Close browser 00:01:01 - MainThread - ocs_ci.ocs.ui.base_ui - INFO - Creating screenshot: /tmp/screenshots_ui_1656527304/test_dashboard_validation_ui/2022-06-30T00-01-01.138459.png

==================================================================== warnings summary ===================================================================== tests/ui/test_validation_ui.py::TestUserInterfaceValidation::test_dashboard_validation_ui /home/amagrawa/Downloads/Work/ocs-ci/venv/lib64/python3.8/site-packages/cryptography/hazmat/backends/openssl/x509.py:14: CryptographyDeprecationWarning: This version of cryptography contains a temporary pyOpenSSL fallback path. Upgrade pyOpenSSL now. warnings.warn(

-- Docs: https://docs.pytest.org/en/stable/warnings.html ======================================================== 1 passed, 1 warning in 147.18s (0:02:27) =========================================================

am-agrawa commented 1 year ago

Failed again- Run ID: 1678742237 Raw capacity could be seen here- hhttps://url.corp.redhat.com/

also, Run ID: 1679099109 Run ID: 1680305295 Run ID: 1680740984

DanielOsypenko commented 1 year ago

"Used Capacity Breakdown", "Raw Capacity" are now "Used capacity breakdown" and "Raw capacity". Function ocs_ci/ocs/ui/base_ui.py::BaseUI::check_element_text is case sensitive

am-agrawa commented 1 year ago

"Used Capacity Breakdown", "Raw Capacity" are now "Used capacity breakdown" and "Raw capacity". Function ocs_ci/ocs/ui/base_ui.py::BaseUI::check_element_text is case sensitive

Great catch @DanielOsypenko, but I wonder why the above validation passed for me when I was tested it locally?

DanielOsypenko commented 1 year ago

it passed on Jun 29, 2022. It might be that the texts were still all starting from upper case on OCP 4.8.0-0.nightly-2022-06-24-002737.
New text links are from 1678742237 run which is 11 month later.


regarding 1649849066 the Raw Capacity fell out of visibility, bellow the screen, something happened there with layout. http://magna002.ceph.redhat.com/ocsci-jenkins/openshift-clusters/j-103ai3c33-uo/j-103ai3c33-uo_20220413T083559/logs/screenshots_ui_1649849066/test_dashboard_validation_ui/2022-04-13T17-30-22.942697.png now that does not happen

am-agrawa commented 1 year ago

it passed on Jun 29, 2022. It might be that the texts were still all starting from upper case on OCP 4.8.0-0.nightly-2022-06-24-002737. New text links are from 1678742237 run which is 11 month later.

regarding 1649849066 the Raw Capacity fell out of visibility, bellow the screen, something happened there with layout. http://magna002.ceph.redhat.com/ocsci-jenkins/openshift-clusters/j-103ai3c33-uo/j-103ai3c33-uo_20220413T083559/logs/screenshots_ui_1649849066/test_dashboard_validation_ui/2022-04-13T17-30-22.942697.png now that does not happen

Sorry didn't get you. I can see "Raw capacity" in this screenshot.

github-actions[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 30 days if no further activity occurs.

github-actions[bot] commented 1 year ago

This issue has been automatically closed due to inactivity. Please re-open if this still requires investigation.