antmicro / renode-zephyr-tech-talk

Apache License 2.0
10 stars 3 forks source link

Tests don't seem to run using Twister #6

Open prdktntwcklr opened 6 months ago

prdktntwcklr commented 6 months ago

When trying to execute the tests using Twister, the test configurations only seem to get built without actually running the tests:

(.venv) PS D:\renode-zephyr-tech-talk\03-twister\example-application> west twister --platform stm32f7 -T shell_module
INFO    - Using Ninja..
INFO    - Zephyr version: v3.5.0-rc2-76-g916df03e7aec
INFO    - Using 'zephyr' toolchain.
INFO    - Building initial testsuite list...
INFO    - Writing JSON report D:\renode-zephyr-tech-talk\03-twister\example-application\twister-out\testplan.json
INFO    - Adding tasks to the queue...
INFO    - Added initial list of jobs to queue
INFO    - Total complete: ←[32m   3/   3←[39m  100%  skipped: ←[39m   0←[39m, failed: ←[39m   0←[39m, error: ←[39m   0←[39m
INFO    - 3 test scenarios (3 test instances) selected, 0 configurations skipped (0 by static filter, 0 at runtime).
INFO    - ←[32m3 of 3←[39m test configurations passed (100.00%), ←[39m0←[39m failed, ←[39m0←[39m errored, 0 skipped with ←[39m0←[39m warnings in 80.11 seconds
INFO    - In total 0 test cases were executed, 3 skipped on 1 out of total 628 platforms (0.16%)
INFO    - ←[32m0←[39m test configurations executed on platforms, ←[31m3←[39m test configurations were only built.
INFO    - Saving reports...
INFO    - Writing JSON report D:\renode-zephyr-tech-talk\03-twister\example-application\twister-out\twister.json
INFO    - Writing xunit report D:\renode-zephyr-tech-talk\03-twister\example-application\twister-out\twister.xml...
INFO    - Writing xunit report D:\renode-zephyr-tech-talk\03-twister\example-application\twister-out\twister_report.xml...
INFO    - Run completed

In particular, the following line indicates that the tests were indeed skipped:

INFO    - In total 0 test cases were executed, 3 skipped on 1 out of total 628 platforms (0.16%)
prdktntwcklr commented 3 months ago

@PiotrZierhoffer Any idea what might be the issue here? Thanks!

PiotrZierhoffer commented 4 days ago

Thanks for reporting @prdktntwcklr

Can you share your Zephyr SDK version? Can you verify if renode is in your $PATH?