search

RIOT-OS / RobotFW-tests

Includes tests for RIOT based on the Robot Framework
GNU Lesser General Public License v2.1
4 stars 13 forks source link

Jenkinsfile: Post results on PR #89

Closed MrKevinWeiss closed 4 years ago

MrKevinWeiss commented 4 years ago

Gets metadata from build server. Update env script to set repo_name for metadata. Compiling results script only uses metadata and does not generate. Add release as build parameter for RIOT. Post test results and link on robot PRs. Always notify at finish.

MrKevinWeiss commented 4 years ago

It seems that the compile results script doesn't work anymore since it is run on master and master does not have RIOT included...

Maybe it is better to have these scripts somewhere else, either way it is a TODO to fix...

MrKevinWeiss commented 4 years ago

We should also show the errors, the only problem is if it is empty then it fails...

riot-ci commented 4 years ago

HiL CI Test Results

Boards Tested: [nucleo-f103rb] Tests Run: [RIOT/tests/bloom_bytes]

Full test results

riot-ci commented 4 years ago

HiL CI Test Results

Boards Tested: [samr21-xpro] Tests Run: [tests/periph_gpio]

Full test results

MrKevinWeiss commented 4 years ago

Take a look at the pr 89 tests and nightly tests to verify everything is OK.

Make sure the robot.xml contains the proper commit id of both robotfw and riot in the metadata tag.

riot-ci commented 4 years ago

HiL CI Test Results

Boards Tested: [samr21-xpro] Tests Run: [tests/periph_gpio]

Full test results

MrKevinWeiss commented 4 years ago

nightlies only update if everything is on master

riot-ci commented 4 years ago

HiL CI Test Results

Boards Tested: [frdm-k22f, nucleo-f091rc, nucleo-f767zi, arduino-mega2560, saml10-xpro, samr21-xpro, remote-revb, nucleo-l073rz, slstk3401a, nucleo-f411re, nucleo-f103rb, frdm-kw41z, esp32-wroom-32, arduino-due] Tests Run: [tests/xtimer_cli, tests/periph_uart, tests/periph_i2c, tests/periph_gpio, tests/periph_timer, tests/periph_spi]

Full test results

riot-ci commented 4 years ago

HiL CI Test Results

Boards Tested: [frdm-k22f, nucleo-f091rc, nucleo-f767zi, arduino-mega2560, saml10-xpro, samr21-xpro, remote-revb, nucleo-l073rz, slstk3401a, nucleo-f411re, nucleo-f103rb, frdm-kw41z, esp32-wroom-32, arduino-due] Tests Run: [RIOT/tests/bloom_bytes/]

Full test results

MrKevinWeiss commented 4 years ago

There are some No such saved stash ‘saml10-xpro_tests_periph_uart’ errors in PR 89 result in HIL. Is that normal?

Yup, I have not found a way to test if a stash is present. Currently if fails in a decent way. Maybe later we would keep track of all the jobs or something, still learning about how the map works...

MrKevinWeiss commented 4 years ago

@pokgak Thanks for looking at this so late! Great that we can get it in before the next nightly test.