Ubuntu 24.04 LTS support

[hiltonlima]

• Fixing prerequisites for the Matter and TH installation
• Improvements on the installation scripts
• Adding wifi connection helper script

Backend PR: https://github.com/project-chip/certification-tool-backend/pull/95

[JonathanHahn]

@hiltonlima Is this anywhere close to being ready? I'm using a pi version 5 and can only install Ubuntu 23.04 or 24.04. Would 23.04 not require any changes to the scripts?

[hiltonlima]

Hey @JonathanHahn,

I believe that at the end of the week I will finish testing with the Raspberry Pi 4 using Ubuntu 24.04. Unfortunately the tests with the Raspberry Pi 5 will take a little longer... as we don't have any available right now.

As soon as the tests are finished I will let you know. And if you can test it in your environment, it would be great to have this feedback.

About ubuntu 23.04. I never tried to install this version. As it is not an LTS version, we have no intention of supporting it.

[hiltonlima]

Hello @JonathanHahn ,

Could you please test on your Raspberry Pi 5?

Please follow these steps:

cd certification-tool
./scripts/stop.sh
cd ..
sudo rm -rf certification-tool
git clone -b ubuntu_24_04 https://github.com/project-chip/certification-tool.git --recurse-submodules
cd certification-tool
./scripts/pi-setup/auto-install.sh

[samryanuofl]

Hey @JonathanHahn,

I believe that at the end of the week I will finish testing with the Raspberry Pi 4 using Ubuntu 24.04. Unfortunately the tests with the Raspberry Pi 5 will take a little longer... as we don't have any available right now.

As soon as the tests are finished I will let you know. And if you can test it in your environment, it would be great to have this feedback.

About ubuntu 23.04. I never tried to install this version. As it is not an LTS version, we have no intention of supporting it.

Hi @hiltonlima , I used those installation steps and tried running some tests on an Rpi 5. The installation all works and I'm able to run some tests, but after a few test cases have run (and passed) I get an error messge like:

- --------------------------------------------------------------------------------
--
- Executing Test Step: Step 3f: Given FAN.S.F04(STEP) ensure featuremap has the correct bit set
- Test Step Error: Error occurred during execution of test case TC-FAN-1.1. sent 1011 (internal error) keepalive ping timeout; no close frame received
- Test Step Completed [ERROR]: Step 3f: Given FAN.S.F04(STEP) ensure featuremap has the correct bit set

And then all of the test cases after that fail with an error like:

- --------------------------------------------------------------------------------
- Executing Test Step: Start chip-tool test
- Using PICS file: /var/tmp/pics
- Test Step Error: Error occurred during execution of test case TC-GRPKEY-1.1. Connecting to ws://172.21.0.1:9002 failed.

It doesn't seem to matter what the test cases are, I can swap them out to different ones but it always seems to reach that state with the connection error. This is my first time running the test harness so not sure if the same thing would happen with a Pi 4. Any thoughts on what might be happening there? Thanks!

[hiltonlima]

Hey @JonathanHahn, I believe that at the end of the week I will finish testing with the Raspberry Pi 4 using Ubuntu 24.04. Unfortunately the tests with the Raspberry Pi 5 will take a little longer... as we don't have any available right now. As soon as the tests are finished I will let you know. And if you can test it in your environment, it would be great to have this feedback. About ubuntu 23.04. I never tried to install this version. As it is not an LTS version, we have no intention of supporting it.

Hi @hiltonlima , I used those installation steps and tried running some tests on an Rpi 5. The installation all works and I'm able to run some tests, but after a few test cases have run (and passed) I get an error messge like:

- --------------------------------------------------------------------------------
--
- Executing Test Step: Step 3f: Given FAN.S.F04(STEP) ensure featuremap has the correct bit set
- Test Step Error: Error occurred during execution of test case TC-FAN-1.1. sent 1011 (internal error) keepalive ping timeout; no close frame received
- Test Step Completed [ERROR]: Step 3f: Given FAN.S.F04(STEP) ensure featuremap has the correct bit set

And then all of the test cases after that fail with an error like:

- --------------------------------------------------------------------------------
- Executing Test Step: Start chip-tool test
- Using PICS file: /var/tmp/pics
- Test Step Error: Error occurred during execution of test case TC-GRPKEY-1.1. Connecting to ws://172.21.0.1:9002 failed.

It doesn't seem to matter what the test cases are, I can swap them out to different ones but it always seems to reach that state with the connection error. This is my first time running the test harness so not sure if the same thing would happen with a Pi 4. Any thoughts on what might be happening there? Thanks!

Hello @samryanuofl,

Thank you very much for your feedback. Good to know that the installation worked on the Raspberry Pi 5.

We may actually have some incompatibility with some version of our dependencies. In this case I could suggest that you validate the same environment with Raspberry Pi 4 with Ubuntu Server 22.04.

1. If the Raspberry Pi 4 works without problems: Then we would have a direction with some version of the dependencies.

2. If the problem also happens with the Raspberry Pi 4: In this case, I recommend opening an issue reporting the steps to reproduce so that our team can investigate the problem.

[samryanuofl]

Thanks @hiltonlima, I'll test it on a 4 after the weekend