sonic-net / sonic-mgmt

Configuration management examples for SONiC
Other
173 stars 689 forks source link

Move stable test from onboarding job to t0/t1 job #13454

Closed xwjiang-ms closed 1 week ago

xwjiang-ms commented 1 week ago

Description of PR

Summary: Fixes # (issue)

Type of change

Back port request

Approach

What is the motivation for this PR?

I have added some dataplane test scripts to PR test and put into optional onboarding job to test case performance, I calculated the success rate of test scripts in recent 1 week, I think I can move high success rate test scripts to t0/t1 job now

TestbedName ModulePath SuccessCount FailureCount TotalTests SuccessRate
vms-kvm-t1-lag acl.test_acl.TestAclWithPortToggle 3989 0 3989 1
vms-kvm-t1-lag acl.test_acl.TestAclWithReboot 4013 2 4015 0.9995
vms-kvm-t1-lag acl.test_acl.TestBasicAcl 3361 0 3361 1
vms-kvm-t1-lag acl.test_acl.TestIncrementalAcl 4008 0 4008 1
vms-kvm-t1-lag acl.test_stress_acl 59 0 59 1
vms-kvm-t0 acl.custom_acl_table.test_custom_acl_table 104 0 104 1
vms-kvm-t0 acl.null_route.test_null_route_helper 105 0 105 1
vms-kvm-t0 acl.test_acl.TestAclWithPortToggle 5215 0 5215 1
vms-kvm-t0 acl.test_acl.TestAclWithReboot 4920 1 4921 0.9998
vms-kvm-t0 acl.test_acl.TestBasicAcl 3063 0 3063 1
vms-kvm-t0 acl.test_acl.TestIncrementalAcl 3734 0 3734 1
vms-kvm-t0 acl.test_stress_acl 119 1 120 0.9917
vms-kvm-t0 arp.test_stress_arp 173 1 174 0.9943
vms-kvm-t0 arp.test_wr_arp.TestWrArp 154 0 154 1

How did you do it?

Move test from onboarding job to t0/t1 job

How did you verify/test it?

Run PR test

Any platform specific information?

Supported testbed topology if it's a new test case?

Documentation