red-hat-storage / ocs-ci

https://ocs-ci.readthedocs.io/en/latest/
MIT License
109 stars 166 forks source link

test_resource_deletion_during_pvc_expansion failing due to size mismatch #9420

Open jilju opened 6 months ago

jilju commented 6 months ago

Tests test_resource_deletion_during_pvc_expansion is failing because the filesystem size on app pod is 29.4G but the test case expects 30G after pvc expansion.

Example test case: tests/functional/pv/pvc_resize/test_resource_deletion_during_pvc_expansion.py::TestResourceDeletionDuringPvcExpansion::test_resource_deletion_during_pvc_expansion[osd]

2024-01-24 12:47:37  07:17:37 - MainThread - tests.functional.pv.pvc_resize.test_resource_deletion_during_pvc_expansion - INFO  - Expanded size of PVC pvc-test-0b51f08397a742c2b9b28d2a6c964b8 is not reflected on pod pod-test-rbd-38355ef084734bd98c8c471b5cc. New size on mount is not 30G as expected, but 29.4G. Checking again.
2024-01-24 12:47:37  07:17:37 - MainThread - ocs_ci.utility.utils - INFO  - Going to sleep for 3 seconds before next iteration
2024-01-24 12:47:40  07:17:40 - ThreadPoolExecutor-777_0 - ocs_ci.ocs.utils - INFO  - RUNNING IN CTX: j-048vi1cs33-t4c RUNID: = 1706046472
2024-01-24 12:47:40  07:17:40 - ThreadPoolExecutor-777_0 - ocs_ci.ocs.utils - INFO  - Must gather image: quay.io/rhceph-dev/ocs-must-gather:latest-4.15 will be used.
2024-01-24 12:47:40  07:17:40 - ThreadPoolExecutor-777_0 - ocs_ci.ocs.utils - INFO  - OCS logs will be placed in location /home/jenkins/current-cluster-dir/logs/failed_testcase_ocs_logs_1706046472/test_resource_deletion_during_pvc_expansion[osd]_ocs_logs/j-048vi1cs33-t4c/ocs_must_gather
2024-01-24 12:47:40  07:17:40 - ThreadPoolExecutor-777_0 - ocs_ci.utility.utils - INFO  - Executing command: oc --kubeconfig /home/jenkins/current-cluster-dir/openshift-cluster-dir/auth/kubeconfig adm must-gather --image=quay.io/rhceph-dev/ocs-must-gather:latest-4.15 --dest-dir=/home/jenkins/current-cluster-dir/logs/failed_testcase_ocs_logs_1706046472/test_resource_deletion_during_pvc_expansion[osd]_ocs_logs/j-048vi1cs33-t4c/ocs_must_gather
2024-01-24 12:52:02  07:21:51 - MainThread - ocs_ci.ocs.utils - INFO  - None
2024-01-24 12:52:02  ------------------------------ live log logreport ------------------------------
2024-01-24 12:52:02  07:21:51 - MainThread - ocs_ci.framework.pytest_customization.reports - INFO  - duration reported by tests/functional/pv/pvc_resize/test_resource_deletion_during_pvc_expansion.py::TestResourceDeletionDuringPvcExpansion::test_resource_deletion_during_pvc_expansion[osd] immediately after test execution: 310.32
2024-01-24 12:52:02  FAILED

Report Portal link - https://reportportal-ocs4.apps.ocp-c1.prod.psi.redhat.com/ui/#ocs/launches/632/18135/888087/888145/log

Pooja-Soni78 commented 3 months ago

I am also getting similar kind of error for the test case tests/manage/pv_services/pvc_resize/test_pvc_expansion.py::TestPvcExpand::test_pvc_expand_expanded_pvc on ODF 4.12 and 4.13 on IBM Power.

MainThread - tests.manage.pv_services.pvc_resize.test_pvc_expansion - INFO  - Expanded size of PVC pvc-test-3470c6be7a934af395ecb7d97d3fb7d is not reflected on pod pod-test-rbd-bacdd2063aad4a26a26f992f770. New size on mount is not 20G as expected, but 19.6G. Checking again.

Logs - test_pvc_expand_expanded_pvc.log

Shilpi-Das1 commented 3 weeks ago

Facing the same issue on latest stream build 4.13.11 on power

jilju commented 1 week ago

@Shilpi-Das1 Do you face the issue in the test test_resource_deletion_during_pvc_expansion ?