search

RIOT-OS / RobotFW-tests

Includes tests for RIOT based on the Robot Framework
GNU Lesser General Public License v2.1
4 stars 13 forks source link

tests/periph_gpio: Adapt reset test to not sleep just 1 second #123

Open MarcelStenzel opened 3 years ago

MarcelStenzel commented 3 years ago

Changes out sleep and the get_metadata call to the given API Sync Shell keyword. This does basically the same but gives more time to boards that need it after resetting.

riot-hil-bot commented 3 years ago
HiL Test Results PASS FAIL SKIP
0 12 0
  ❌ hifive1b (3 fail build) |PASS|FAIL|SKIP |-|-|- |0|3|0 |TEST|RESULT |-|- |[periph_spi](https://hil.riot-os.org/results/robot_tests/37/hifive1b/periph_spi/console_log.html)|❌ build fail |[periph_i2c](https://hil.riot-os.org/results/robot_tests/37/hifive1b/periph_i2c/console_log.html)|❌ build fail |[periph_gpio](https://hil.riot-os.org/results/robot_tests/37/hifive1b/periph_gpio/console_log.html)|❌ build fail
  ❌ same54-xpro (3 fail build) |PASS|FAIL|SKIP |-|-|- |0|3|0 |TEST|RESULT |-|- |[periph_spi](https://hil.riot-os.org/results/robot_tests/37/same54-xpro/periph_spi/console_log.html)|❌ build fail |[periph_i2c](https://hil.riot-os.org/results/robot_tests/37/same54-xpro/periph_i2c/console_log.html)|❌ build fail |[periph_gpio](https://hil.riot-os.org/results/robot_tests/37/same54-xpro/periph_gpio/console_log.html)|❌ build fail
  ❌ samr34-xpro (3 fail build) |PASS|FAIL|SKIP |-|-|- |0|3|0 |TEST|RESULT |-|- |[periph_spi](https://hil.riot-os.org/results/robot_tests/37/samr34-xpro/periph_spi/console_log.html)|❌ build fail |[periph_i2c](https://hil.riot-os.org/results/robot_tests/37/samr34-xpro/periph_i2c/console_log.html)|❌ build fail |[periph_gpio](https://hil.riot-os.org/results/robot_tests/37/samr34-xpro/periph_gpio/console_log.html)|❌ build fail
  ❌ stk3200 (3 fail build) |PASS|FAIL|SKIP |-|-|- |0|3|0 |TEST|RESULT |-|- |[periph_spi](https://hil.riot-os.org/results/robot_tests/37/stk3200/periph_spi/console_log.html)|❌ build fail |[periph_i2c](https://hil.riot-os.org/results/robot_tests/37/stk3200/periph_i2c/console_log.html)|❌ build fail |[periph_gpio](https://hil.riot-os.org/results/robot_tests/37/stk3200/periph_gpio/console_log.html)|❌ build fail
riot-hil-bot commented 3 years ago
HiL Test Results PASS FAIL SKIP
0 11 1
  ❌ hifive1b (3 fail test) |PASS|FAIL|SKIP |-|-|- |0|3|0 |TEST|RESULT |-|- |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/38/hifive1b/tests_periph_spi/console_log.html)|❌ test fail |[tests/periph_i2c](https://hil.riot-os.org/results/robot_tests/38/hifive1b/tests_periph_i2c/console_log.html)|❌ test fail |[tests/periph_gpio](https://hil.riot-os.org/results/robot_tests/38/hifive1b/tests_periph_gpio/console_log.html)|❌ test fail
  ❌ same54-xpro (3 fail test) |PASS|FAIL|SKIP |-|-|- |0|3|0 |TEST|RESULT |-|- |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/38/same54-xpro/tests_periph_spi/console_log.html)|❌ test fail |[tests/periph_i2c](https://hil.riot-os.org/results/robot_tests/38/same54-xpro/tests_periph_i2c/console_log.html)|❌ test fail |[tests/periph_gpio](https://hil.riot-os.org/results/robot_tests/38/same54-xpro/tests_periph_gpio/console_log.html)|❌ test fail
  ❌ samr34-xpro (2 fail test) |PASS|FAIL|SKIP |-|-|- |0|2|1 |TEST|RESULT |-|- |[tests/periph_i2c](https://hil.riot-os.org/results/robot_tests/38/samr34-xpro/tests_periph_i2c/console_log.html)|❌ test fail |[tests/periph_gpio](https://hil.riot-os.org/results/robot_tests/38/samr34-xpro/tests_periph_gpio/console_log.html)|❌ test fail |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/38/samr34-xpro/tests_periph_spi/console_log.html)|🙈 skip
  ❌ stk3200 (3 fail test) |PASS|FAIL|SKIP |-|-|- |0|3|0 |TEST|RESULT |-|- |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/38/stk3200/tests_periph_spi/console_log.html)|❌ test fail |[tests/periph_i2c](https://hil.riot-os.org/results/robot_tests/38/stk3200/tests_periph_i2c/console_log.html)|❌ test fail |[tests/periph_gpio](https://hil.riot-os.org/results/robot_tests/38/stk3200/tests_periph_gpio/console_log.html)|❌ test fail
MarcelStenzel commented 3 years ago

Out of WIP. There was an issue with the bluepill of the same54. The bluepill has been exchanged. The stk3200 and samr34 had wiring issues with the reset pin which are solved now.

riot-hil-bot commented 3 years ago
HiL Test Results PASS FAIL SKIP
25 6 0
  ❌ nucleo-f091rc (1 fail test) |PASS|FAIL|SKIP |-|-|- |0|1|0 |TEST|RESULT |-|- |[tests/periph_gpio](https://hil.riot-os.org/results/robot_tests/79/nucleo-f091rc/tests_periph_gpio/console_log.html)|❌ test fail
  ❌ nucleo-f767zi (1 fail test) |PASS|FAIL|SKIP |-|-|- |0|1|0 |TEST|RESULT |-|- |[tests/periph_gpio](https://hil.riot-os.org/results/robot_tests/79/nucleo-f767zi/tests_periph_gpio/console_log.html)|❌ test fail
  ❌ z1 (1 fail test) |PASS|FAIL|SKIP |-|-|- |0|1|0 |TEST|RESULT |-|- |[tests/periph_gpio](https://hil.riot-os.org/results/robot_tests/79/z1/tests_periph_gpio/console_log.html)|❌ test fail
  ❌ arduino-due (1 fail test) |PASS|FAIL|SKIP |-|-|- |0|1|0 |TEST|RESULT |-|- |[tests/periph_gpio](https://hil.riot-os.org/results/robot_tests/79/arduino-due/tests_periph_gpio/console_log.html)|❌ test fail
  ❌ frdm-k64f (1 fail test) |PASS|FAIL|SKIP |-|-|- |0|1|0 |TEST|RESULT |-|- |[tests/periph_gpio](https://hil.riot-os.org/results/robot_tests/79/frdm-k64f/tests_periph_gpio/console_log.html)|❌ test fail
  😬 arduino-mega2560 (1 fail flash) |PASS|FAIL|SKIP |-|-|- |0|1|0 |TEST|RESULT |-|- |[tests/periph_gpio](https://hil.riot-os.org/results/robot_tests/79/arduino-mega2560/tests_periph_gpio/console_log.html)|😬 flash fail
  ✅ frdm-k22f |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ nucleo-f303re |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ same54-xpro |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ nucleo-l152re |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ saml21-xpro |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ nucleo-l432kc |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ hifive1b |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ saml10-xpro |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ saml11-xpro |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ samr30-xpro |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ samr21-xpro |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ samr34-xpro |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ nrf52dk |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ remote-revb |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ nucleo-f207zg |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ nucleo-l073rz |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ slstk3401a |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ nucleo-g474re |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ nucleo-f411re |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ nucleo-f103rb |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ frdm-kw41z |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ esp8266-esp-12x |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ esp32-wroom-32 |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ slstk3400a |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
  ✅ stk3200 |PASS|FAIL|SKIP |-|-|- |1|0|0 |TEST|RESULT |-|- |tests/periph_gpio|✅ pass
riot-hil-bot commented 3 years ago
HiL Test Results PASS FAIL SKIP
31 21 4
  ❌ nucleo-f207zg (2 fail test) |PASS|FAIL|SKIP |-|-|- |5|2|0 |TEST|RESULT |-|- |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/82/nucleo-f207zg/tests_periph_spi/console_log.html)|❌ test fail |[tests/periph_gpio](https://hil.riot-os.org/results/robot_tests/82/nucleo-f207zg/tests_periph_gpio/console_log.html)|❌ test fail |tests/ztimer_benchmarks|✅ pass |tests/xtimer_benchmarks|✅ pass |tests/periph_uart|✅ pass |tests/periph_timer|✅ pass |tests/periph_i2c|✅ pass
  ❌ hifive1b (7 fail test) |PASS|FAIL|SKIP |-|-|- |0|7|0 |TEST|RESULT |-|- |[tests/ztimer_benchmarks](https://hil.riot-os.org/results/robot_tests/82/hifive1b/tests_ztimer_benchmarks/console_log.html)|❌ test fail |[tests/xtimer_benchmarks](https://hil.riot-os.org/results/robot_tests/82/hifive1b/tests_xtimer_benchmarks/console_log.html)|❌ test fail |[tests/periph_uart](https://hil.riot-os.org/results/robot_tests/82/hifive1b/tests_periph_uart/console_log.html)|❌ test fail |[tests/periph_timer](https://hil.riot-os.org/results/robot_tests/82/hifive1b/tests_periph_timer/console_log.html)|❌ test fail |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/82/hifive1b/tests_periph_spi/console_log.html)|❌ test fail |[tests/periph_i2c](https://hil.riot-os.org/results/robot_tests/82/hifive1b/tests_periph_i2c/console_log.html)|❌ test fail |[tests/periph_gpio](https://hil.riot-os.org/results/robot_tests/82/hifive1b/tests_periph_gpio/console_log.html)|❌ test fail
  ❌ same54-xpro (2 fail test) |PASS|FAIL|SKIP |-|-|- |5|2|0 |TEST|RESULT |-|- |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/82/same54-xpro/tests_periph_spi/console_log.html)|❌ test fail |[tests/periph_i2c](https://hil.riot-os.org/results/robot_tests/82/same54-xpro/tests_periph_i2c/console_log.html)|❌ test fail |tests/ztimer_benchmarks|✅ pass |tests/xtimer_benchmarks|✅ pass |tests/periph_uart|✅ pass |tests/periph_timer|✅ pass |tests/periph_gpio|✅ pass
  ❌ samr30-xpro (2 fail test) |PASS|FAIL|SKIP |-|-|- |4|2|1 |TEST|RESULT |-|- |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/82/samr30-xpro/tests_periph_spi/console_log.html)|❌ test fail |[tests/periph_i2c](https://hil.riot-os.org/results/robot_tests/82/samr30-xpro/tests_periph_i2c/console_log.html)|❌ test fail |tests/ztimer_benchmarks|✅ pass |tests/xtimer_benchmarks|✅ pass |[tests/periph_uart](https://hil.riot-os.org/results/robot_tests/82/samr30-xpro/tests_periph_uart/console_log.html)|🙈 skip |tests/periph_timer|✅ pass |tests/periph_gpio|✅ pass
  ❌ samr34-xpro (1 fail test) |PASS|FAIL|SKIP |-|-|- |4|1|2 |TEST|RESULT |-|- |[tests/periph_i2c](https://hil.riot-os.org/results/robot_tests/82/samr34-xpro/tests_periph_i2c/console_log.html)|❌ test fail |tests/ztimer_benchmarks|✅ pass |tests/xtimer_benchmarks|✅ pass |[tests/periph_uart](https://hil.riot-os.org/results/robot_tests/82/samr34-xpro/tests_periph_uart/console_log.html)|🙈 skip |tests/periph_timer|✅ pass |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/82/samr34-xpro/tests_periph_spi/console_log.html)|🙈 skip |tests/periph_gpio|✅ pass
  ❌ stk3200 (3 fail test) (1 fail build) |PASS|FAIL|SKIP |-|-|- |2|4|1 |TEST|RESULT |-|- |[tests/ztimer_benchmarks](https://hil.riot-os.org/results/robot_tests/82/stk3200/tests_ztimer_benchmarks/console_log.html)|❌ test fail |[tests/xtimer_benchmarks](https://hil.riot-os.org/results/robot_tests/82/stk3200/tests_xtimer_benchmarks/console_log.html)|❌ build fail |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/82/stk3200/tests_periph_spi/console_log.html)|❌ test fail |[tests/periph_i2c](https://hil.riot-os.org/results/robot_tests/82/stk3200/tests_periph_i2c/console_log.html)|❌ test fail |[tests/periph_uart](https://hil.riot-os.org/results/robot_tests/82/stk3200/tests_periph_uart/console_log.html)|🙈 skip |tests/periph_timer|✅ pass |tests/periph_gpio|✅ pass
  ❌ saml21-xpro (1 fail test) |PASS|FAIL|SKIP |-|-|- |6|1|0 |TEST|RESULT |-|- |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/82/saml21-xpro/tests_periph_spi/console_log.html)|❌ test fail |tests/ztimer_benchmarks|✅ pass |tests/xtimer_benchmarks|✅ pass |tests/periph_uart|✅ pass |tests/periph_timer|✅ pass |tests/periph_i2c|✅ pass |tests/periph_gpio|✅ pass
  ❌ nucleo-g474re (2 fail test) |PASS|FAIL|SKIP |-|-|- |5|2|0 |TEST|RESULT |-|- |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/82/nucleo-g474re/tests_periph_spi/console_log.html)|❌ test fail |[tests/periph_i2c](https://hil.riot-os.org/results/robot_tests/82/nucleo-g474re/tests_periph_i2c/console_log.html)|❌ test fail |tests/ztimer_benchmarks|✅ pass |tests/xtimer_benchmarks|✅ pass |tests/periph_uart|✅ pass |tests/periph_timer|✅ pass |tests/periph_gpio|✅ pass
riot-hil-bot commented 3 years ago
HiL Test Results PASS FAIL SKIP
35 17 4
  ❌ nucleo-f207zg (2 fail test) |PASS|FAIL|SKIP |-|-|- |5|2|0 |TEST|RESULT |-|- |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/83/nucleo-f207zg/tests_periph_spi/console_log.html)|❌ test fail |[tests/periph_gpio](https://hil.riot-os.org/results/robot_tests/83/nucleo-f207zg/tests_periph_gpio/console_log.html)|❌ test fail |tests/ztimer_benchmarks|✅ pass |tests/xtimer_benchmarks|✅ pass |tests/periph_uart|✅ pass |tests/periph_timer|✅ pass |tests/periph_i2c|✅ pass
  ❌ hifive1b (2 fail test) |PASS|FAIL|SKIP |-|-|- |5|2|0 |TEST|RESULT |-|- |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/83/hifive1b/tests_periph_spi/console_log.html)|❌ test fail |[tests/periph_i2c](https://hil.riot-os.org/results/robot_tests/83/hifive1b/tests_periph_i2c/console_log.html)|❌ test fail |tests/ztimer_benchmarks|✅ pass |tests/xtimer_benchmarks|✅ pass |tests/periph_uart|✅ pass |tests/periph_timer|✅ pass |tests/periph_gpio|✅ pass
  ❌ same54-xpro (2 fail test) |PASS|FAIL|SKIP |-|-|- |5|2|0 |TEST|RESULT |-|- |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/83/same54-xpro/tests_periph_spi/console_log.html)|❌ test fail |[tests/periph_i2c](https://hil.riot-os.org/results/robot_tests/83/same54-xpro/tests_periph_i2c/console_log.html)|❌ test fail |tests/ztimer_benchmarks|✅ pass |tests/xtimer_benchmarks|✅ pass |tests/periph_uart|✅ pass |tests/periph_timer|✅ pass |tests/periph_gpio|✅ pass
  ❌ samr30-xpro (2 fail test) |PASS|FAIL|SKIP |-|-|- |4|2|1 |TEST|RESULT |-|- |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/83/samr30-xpro/tests_periph_spi/console_log.html)|❌ test fail |[tests/periph_i2c](https://hil.riot-os.org/results/robot_tests/83/samr30-xpro/tests_periph_i2c/console_log.html)|❌ test fail |tests/ztimer_benchmarks|✅ pass |tests/xtimer_benchmarks|✅ pass |[tests/periph_uart](https://hil.riot-os.org/results/robot_tests/83/samr30-xpro/tests_periph_uart/console_log.html)|🙈 skip |tests/periph_timer|✅ pass |tests/periph_gpio|✅ pass
  ❌ samr34-xpro (1 fail test) |PASS|FAIL|SKIP |-|-|- |4|1|2 |TEST|RESULT |-|- |[tests/periph_i2c](https://hil.riot-os.org/results/robot_tests/83/samr34-xpro/tests_periph_i2c/console_log.html)|❌ test fail |tests/ztimer_benchmarks|✅ pass |tests/xtimer_benchmarks|✅ pass |[tests/periph_uart](https://hil.riot-os.org/results/robot_tests/83/samr34-xpro/tests_periph_uart/console_log.html)|🙈 skip |tests/periph_timer|✅ pass |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/83/samr34-xpro/tests_periph_spi/console_log.html)|🙈 skip |tests/periph_gpio|✅ pass
  ❌ stk3200 (3 fail test) (1 fail build) |PASS|FAIL|SKIP |-|-|- |2|4|1 |TEST|RESULT |-|- |[tests/ztimer_benchmarks](https://hil.riot-os.org/results/robot_tests/83/stk3200/tests_ztimer_benchmarks/console_log.html)|❌ test fail |[tests/xtimer_benchmarks](https://hil.riot-os.org/results/robot_tests/83/stk3200/tests_xtimer_benchmarks/console_log.html)|❌ build fail |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/83/stk3200/tests_periph_spi/console_log.html)|❌ test fail |[tests/periph_i2c](https://hil.riot-os.org/results/robot_tests/83/stk3200/tests_periph_i2c/console_log.html)|❌ test fail |[tests/periph_uart](https://hil.riot-os.org/results/robot_tests/83/stk3200/tests_periph_uart/console_log.html)|🙈 skip |tests/periph_timer|✅ pass |tests/periph_gpio|✅ pass
  ❌ saml21-xpro (2 fail test) |PASS|FAIL|SKIP |-|-|- |5|2|0 |TEST|RESULT |-|- |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/83/saml21-xpro/tests_periph_spi/console_log.html)|❌ test fail |[tests/periph_i2c](https://hil.riot-os.org/results/robot_tests/83/saml21-xpro/tests_periph_i2c/console_log.html)|❌ test fail |tests/ztimer_benchmarks|✅ pass |tests/xtimer_benchmarks|✅ pass |tests/periph_uart|✅ pass |tests/periph_timer|✅ pass |tests/periph_gpio|✅ pass
  ❌ nucleo-g474re (2 fail test) |PASS|FAIL|SKIP |-|-|- |5|2|0 |TEST|RESULT |-|- |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/83/nucleo-g474re/tests_periph_spi/console_log.html)|❌ test fail |[tests/periph_i2c](https://hil.riot-os.org/results/robot_tests/83/nucleo-g474re/tests_periph_i2c/console_log.html)|❌ test fail |tests/ztimer_benchmarks|✅ pass |tests/xtimer_benchmarks|✅ pass |tests/periph_uart|✅ pass |tests/periph_timer|✅ pass |tests/periph_gpio|✅ pass
MrKevinWeiss commented 3 years ago

The tests results show:

riot-hil-bot commented 3 years ago
HiL Test Results PASS FAIL SKIP
1 1 0
  ❌ nucleo-f207zg (1 fail test) |PASS|FAIL|SKIP |-|-|- |1|1|0 |TEST|RESULT |-|- |[tests/periph_spi](https://hil.riot-os.org/results/robot_tests/91/nucleo-f207zg/tests_periph_spi/console_log.html)|❌ test fail |tests/periph_gpio|✅ pass