Broken configs for novacustom-nv41* platforms

krystian-hebel commented 4 months ago

Device

novacustom-nv41*

RTE version

does not apply

Affected component(s) or functionality

No response

Brief summary

All of novacustom-nv41* configs try to import file that doesn't exist

How reproducible

No response

How to reproduce

Start any test with any novacustom-nv41* config

Expected behavior

Test suite succeeds

Actual behavior

[ ERROR ] Error in file '/media/krystian/2171d05c-871e-4770-a24e-cc2073b9ab73/work/open-source-firmware-validation/platform-configs/novacustom-nv41mb.robot' on line 2: Resource file '../os/ubuntu_2204_credentials.robot' does not exist.
[ ERROR ] Error in file '/media/krystian/2171d05c-871e-4770-a24e-cc2073b9ab73/work/open-source-firmware-validation/platform-configs/novacustom-nv41mb.robot' on line 32: Setting variable '${DEVICE_UBUNTU_USERNAME}' failed: Variable '${UBUNTU_USERNAME}' not found.

Link to screenshots or logs

log_html_but_GH_doesnt_like_it.txt

Additional context

No response

Solutions you've tried

No response

mkopec commented 3 months ago

Working on it in https://github.com/Dasharo/open-source-firmware-validation/pull/260

mkopec commented 3 months ago

Fixed in https://github.com/Dasharo/open-source-firmware-validation/pull/260 , i can now run tests using nv41pz in test station:

> robot -v snipeit:no -L TRACE -v rte_ip:192.168.4.180 -v device_ip:192.168.4.60 -v config:novacustom-ts1 -v installed_dut:novacustom-nv41pz dasharo-compatibility/usb-camera.robot
==============================================================================
Usb-Camera
==============================================================================
CAM001.001 Integrated webcam (Ubuntu 22.04) :: Check whether the i... ....
Checking if ffmpeg is installed...

Package ffmpeg is installed
.
Checking if libinput-tools is installed...

Package libinput-tools is installed
CAM001.001 Integrated webcam (Ubuntu 22.04) :: Check whether the i... | PASS |
------------------------------------------------------------------------------
CAM001.002 Integrated webcam (Windows 11) :: Check whether the int... | SKIP |
CAM001.002 not supported
------------------------------------------------------------------------------
CAM002.001 Integrated IR Camera (Ubuntu 22.04) :: Check whether th... ....
Checking if ffmpeg is installed...

Package ffmpeg is installed
.
Checking if libinput-tools is installed...

Package libinput-tools is installed
CAM002.001 Integrated IR Camera (Ubuntu 22.04) :: Check whether th... | PASS |
------------------------------------------------------------------------------
Usb-Camera                                                            | PASS |
3 tests, 2 passed, 0 failed, 1 skipped
==============================================================================
Output:  /home/michal/Development/Dasharo/osfv/output.xml
Log:     /home/michal/Development/Dasharo/osfv/log.html
Report:  /home/michal/Development/Dasharo/osfv/report.html

Should probably document the test station stuff a bit

macpijan commented 2 months ago

@mkopec

Should probably document the test station stuff a bit

Do we have some documentation already?

What exactly do you have in mind? Can you summarize the documentation implementation plan (if any) with checklist here?

macpijan commented 13 hours ago

@mkopec @filipleple I think we do already have some documentation for running on laptops, can you please link it here? It should explain what is expected to work on laptops, and how to run these tests.

filipleple commented 50 minutes ago

@macpijan here's what we currently have on running tests on NVC laptops

Dasharo / open-source-firmware-validation