pdbs are not created post second node drain in test_pdb_check_simultaneous_node_drains

[pintojoy]

@bugzilla("1861104") @bugzilla("1946573") @pytest.mark.polarion_id("OCS-2524") @tier4a def test_pdb_check_simultaneous_node_drains( self, pvc_factory, pod_factory, bucket_factory, rgw_bucket_factory, node_drain_teardown, ): """

• Check for OSD PDBs before drain
• Maintenance (mark as unschedulable and drain) 2 worker node with delay of 30 secs
• Drain will be completed on worker node A
• Drain will be pending on worker node B due to blocking PDBs
• Check mon failover in first 10 mins, then 15 and 20 mins
• Check the OSD PDBs
• Mark the node A as schedulable
• Let drain finish on Node B
• Again check mon failover in first 10 mins and then in intervals
• Mark the node B as schedulable

• Check cluster and Ceph health

  """

  Validate OSD PDBs before drain operation

  assert ( not validate_existence_of_blocking_pdb() ), "Blocking PDBs exist, Can't perform drain"

  Get 2 worker nodes to drain

  typed_nodes = get_nodes(num_of_nodes=2) assert len(typed_nodes) == 2, "Failed to find worker nodes for the test" node_A = typed_nodes[0].name node_B = typed_nodes[1].name

  Drain Node A and validate blocking PDBs

  drain_nodes([node_A]) pdb_sample = TimeoutSampler( timeout=100, sleep=10, func=validate_existence_of_blocking_pdb, ) if not pdb_sample: log.error("Failed to create PDBs post node A drain") else: log.info("PDBs are created post node A drain")

  Inducing delay between 2 drains

  Node-B drain expected to be in pending due to blocking PDBs

  time.sleep(30) try: drain_nodes([node_B])

  After the drain check Mon failover in 10th, 15th and 20th min

  timeout = [600, 300, 300]
  for failover in timeout:
      sample = TimeoutSampler(
          timeout=failover,
          sleep=10,
          func=helpers.check_number_of_mon_pods,
      )
      if not sample.wait_for_func_status(result=True):
          assert "Number of mon pods not equal to expected_mon_count=3"

  except TimeoutExpired:

  Mark the node-A back to schedulable and let drain finish in Node-B

  schedule_nodes([node_A])

  time.sleep(40)

  Validate OSD PDBs

  assert ( validate_existence_of_blocking_pdb() ), "Blocking PDBs not created post second drain" E AssertionError: Blocking PDBs not created post second drain E assert False E + where False = validate_existence_of_blocking_pdb()

tests/manage/z_cluster/nodes/test_nodes_maintenance.py:510: AssertionError

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 30 days if no further activity occurs.

[github-actions[bot]]

This issue has been automatically closed due to inactivity. Please re-open if this still requires investigation.