search

kytos-ng / kytos-end-to-end-tests

Kytos End-to-End Tests
0 stars 10 forks source link

Added e2e tests for untagged and any new EVCs #210

Closed Alopalao closed 1 year ago

Alopalao commented 1 year ago

Related to mef_eline and of_core PRs

Summary

Tests including the recent addition to vlan available values untagged and any.

Local Tests

tests/test_e2e_20_flow_manager.py ....................                   [ 39%]
tests/test_e2e_21_flow_manager.py ..                                     [ 43%]
tests/test_e2e_22_flow_manager.py ...............                        [ 72%]
tests/test_e2e_23_flow_manager.py ..............                         [100%]
Alopalao commented 1 year ago

Yes, the results are posted on mef_eline PR too,

tests/test_e2e_01_kytos_startup.py ..                                    [  0%]
tests/test_e2e_05_topology.py ..................                         [  9%]
tests/test_e2e_10_mef_eline.py ..........ss.....x.....x........R.        [ 25%]
tests/test_e2e_11_mef_eline.py .....                                     [ 27%]
tests/test_e2e_12_mef_eline.py .....xx.                                  [ 31%]
tests/test_e2e_13_mef_eline.py .....xxXx......xxXx.XXxX.xxxx..x......... [ 50%]
...                                                                      [ 52%]
tests/test_e2e_14_mef_eline.py x                                         [ 52%]
tests/test_e2e_15_mef_eline.py ..                                        [ 53%]
tests/test_e2e_20_flow_manager.py .....RRF.RRF...........                [ 62%]
tests/test_e2e_21_flow_manager.py ...                                    [ 64%]
tests/test_e2e_22_flow_manager.py ...............                        [ 71%]
tests/test_e2e_23_flow_manager.py ..............                         [ 78%]
tests/test_e2e_30_of_lldp.py ....                                        [ 80%]
tests/test_e2e_31_of_lldp.py R...                                        [ 81%]
tests/test_e2e_32_of_lldp.py ...                                         [ 82%]
tests/test_e2e_40_sdntrace.py RRF.RRFRRF                                 [ 84%]
tests/test_e2e_41_kytos_auth.py ........                                 [ 88%]
tests/test_e2e_50_maintenance.py ........................                [100%]
viniarck commented 1 year ago

Yes, the results are posted on mef_eline PR too,

tests/test_e2e_01_kytos_startup.py ..                                    [  0%]
tests/test_e2e_05_topology.py ..................                         [  9%]
tests/test_e2e_10_mef_eline.py ..........ss.....x.....x........R.        [ 25%]
tests/test_e2e_11_mef_eline.py .....                                     [ 27%]
tests/test_e2e_12_mef_eline.py .....xx.                                  [ 31%]
tests/test_e2e_13_mef_eline.py .....xxXx......xxXx.XXxX.xxxx..x......... [ 50%]
...                                                                      [ 52%]
tests/test_e2e_14_mef_eline.py x                                         [ 52%]
tests/test_e2e_15_mef_eline.py ..                                        [ 53%]
tests/test_e2e_20_flow_manager.py .....RRF.RRF...........                [ 62%]
tests/test_e2e_21_flow_manager.py ...                                    [ 64%]
tests/test_e2e_22_flow_manager.py ...............                        [ 71%]
tests/test_e2e_23_flow_manager.py ..............                         [ 78%]
tests/test_e2e_30_of_lldp.py ....                                        [ 80%]
tests/test_e2e_31_of_lldp.py R...                                        [ 81%]
tests/test_e2e_32_of_lldp.py ...                                         [ 82%]
tests/test_e2e_40_sdntrace.py RRF.RRFRRF                                 [ 84%]
tests/test_e2e_41_kytos_auth.py ........                                 [ 88%]
tests/test_e2e_50_maintenance.py ........................                [100%]

Nice. sdntrace_cp failing is expected until this issue https://github.com/kytos-ng/sdntrace_cp/issues/78 is addressed. I've noticed some reruns on this output here, later on I'll also recommend for you to run each test isolated here and keep eye on reruns they're not usually expected when tests are stable and written in way that favor deterministic execution.

viniarck commented 1 year ago

Yes, the results are posted on mef_eline PR too,

tests/test_e2e_01_kytos_startup.py ..                                    [  0%]
tests/test_e2e_05_topology.py ..................                         [  9%]
tests/test_e2e_10_mef_eline.py ..........ss.....x.....x........R.        [ 25%]
tests/test_e2e_11_mef_eline.py .....                                     [ 27%]
tests/test_e2e_12_mef_eline.py .....xx.                                  [ 31%]
tests/test_e2e_13_mef_eline.py .....xxXx......xxXx.XXxX.xxxx..x......... [ 50%]
...                                                                      [ 52%]
tests/test_e2e_14_mef_eline.py x                                         [ 52%]
tests/test_e2e_15_mef_eline.py ..                                        [ 53%]
tests/test_e2e_20_flow_manager.py .....RRF.RRF...........                [ 62%]
tests/test_e2e_21_flow_manager.py ...                                    [ 64%]
tests/test_e2e_22_flow_manager.py ...............                        [ 71%]
tests/test_e2e_23_flow_manager.py ..............                         [ 78%]
tests/test_e2e_30_of_lldp.py ....                                        [ 80%]
tests/test_e2e_31_of_lldp.py R...                                        [ 81%]
tests/test_e2e_32_of_lldp.py ...                                         [ 82%]
tests/test_e2e_40_sdntrace.py RRF.RRFRRF                                 [ 84%]
tests/test_e2e_41_kytos_auth.py ........                                 [ 88%]
tests/test_e2e_50_maintenance.py ........................                [100%]

@Alopalao I've closed the threads that I opened. Thanks for pushing these updates. Other than the threads that you're aligning with Italo, when it's done, please rerun e2e selecting flow_manager related tests.

Also, another piece of advice will be to break this PR in two, since mef_eline PR is still in review, if you split it in two, covering flow_manager here and mef_eline on another one then of_core PR https://github.com/kytos-ng/of_core/pull/98 could land soon as well once this PR here is approved. You could still keep both but it will sit longer in code review.

Alopalao commented 1 year ago

New build test results:

tests/test_e2e_20_flow_manager.py ....................                   [ 39%]
tests/test_e2e_21_flow_manager.py ..                                     [ 43%]
tests/test_e2e_22_flow_manager.py ...............                        [ 72%]
tests/test_e2e_23_flow_manager.py ..............                         [100%]