Test last stable vpp releases and do update if no problems occurred

networkservicemesh / govpp

Apache License 2.0

0 stars 5 forks source link

Test last stable vpp releases and do update if no problems occurred #24

Open denis-tingaikin opened 9 months ago

denis-tingaikin commented 9 months ago

Plan:

Check and test all stable releases since our current vpp version. For testing, use forwarder-vpp docker tests and NSM integration tests.
If no problem occurred, just do an update
Otherwise, provide a table with the next information: vpp version, which tests don't work
[Optional] Find a root cause of problems and reproduce it via pure VPP.
[Optional] Report found problems to vpp
[Optional] Commit fixes.

NikitaSkrynnik commented 8 months ago

NSM doesn't work with VPP v24.02 and Calico stilll uses v24.02-rc0. I think it's reasonable to wait for a new release from Calico and then update VPP in NSM

Ex4amp1e commented 1 month ago

Plan:

[ ] vpp 24.06
[ ] vpp 24.02

Decomposition:

[x] Run govpp docker tests without changes - 30m
[x] Build govpp based on vpp 24.06 - 4h
[x] Run cmd-forwarder-vpp tests based on vpp 24.06 - 2h
[ ] Build govpp based on vpp 24.02 - 4h
[ ] Run cmd-forwarder-vpp tests based on vpp 24.06 - 2h

Ex4amp1e commented 1 month ago

Current results: cmd-forwarder-vpp docker tests fail on vpp v24.06:

            --- FAIL: TestForwarderTestSuite/TestCombinations/Ethernet/Memif (2.53s)
                --- FAIL: TestForwarderTestSuite/TestCombinations/Ethernet/Memif/Kernel (0.66s)
                --- FAIL: TestForwarderTestSuite/TestCombinations/Ethernet/Memif/Memif (0.92s)
                --- FAIL: TestForwarderTestSuite/TestCombinations/Ethernet/Memif/Vxlan (0.95s)

Note: ipv6 pings fail Full docker log: 24.06.new.txt

vpp v24.02 has been tested and NSM doesn't work https://github.com/networkservicemesh/govpp/issues/24#issuecomment-1998889081

Possible options: Option 1: Find the root cause why Ethernet/Memif tests do not work in vpp code Option 2: Wait vpp v24.10 (looks like it should be released at the end of Oct 2024) and test it

denis-tingaikin commented 1 month ago

cc @szvincze

elajkat commented 3 weeks ago

24.10 is out, see the re-no page: https://s3-docs.fd.io/vpp/24.10/aboutvpp/releasenotes/v24.10.html (https://gerrit.fd.io/r/c/vpp/+/41646 )

elajkat commented 3 weeks ago

I am not sure I use the govpp api diff in correct way but the API diff for v23.06 to v24.06: https://pastebin.com/jQjPWdWN

(I used the command: $ cd ~/temp; git clone https://github.com/FDio/vpp; git checkout v24.06; cd ~/vpp; git checkout v23.06; govpp vppapi diff --against ~/temp/vpp/ ) Perhaps worth to check first the API diff why those tests are failing.

(The API diff for 23.06=>24.10 is here: https://pastebin.com/L52EqTzX )