search

RIOT-OS / Release-Specs

Specification for RIOT releases and corresponding test configurations
4 stars 21 forks source link

Release 2023.04 - RC2 #281

Closed MrKevinWeiss closed 1 year ago

MrKevinWeiss commented 1 year ago

This issue lists the status of all tests for the Release Candidate 2 of the 2023.04 release.

Specs tested:

riot-ci commented 1 year ago

Test Report

Task Outcome
✔ 01. Task 02 - Unittests on native PASSED
✔ 01. Task 03 - Unittests on native separated [tests-analog_util] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-base64] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bcd] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bhp_event] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bhp_msg] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bitfield] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bloom] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bluetil] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-checksum] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-chunked_ringbuffer] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-clif] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-coding] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-color] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-core] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-credman] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-div] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-dns_cache] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ecc] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-fib] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-fib_sr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-fmt] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-frac] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gcoap] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_ipv6] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_ipv6_hdr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_ipv6_nib] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_mac_internal] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_netif_pktq] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_sixlowpan_frag_vrb] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_udp] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-hashes] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ieee802154] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-inet_csum] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ipv4_addr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ipv6_addr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ipv6_hdr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-kernel_defines] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-libc] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-luid] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-matstat] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-mtd] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-nanocoap] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-nanocoap_cache] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-netopt] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-netreg] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-phydat] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-pkt] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-pktbuf] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-pktqueue] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-printf_float] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-priority_pktqueue] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-rtc] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-rtt_rtc] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-saul_reg] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-scanf_float] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-seq] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sht1x] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sixlowpan] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sixlowpan_ctx] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sixlowpan_sfr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sock_util] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-timex] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-tsrb] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-turo] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-uri_parser] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ut_process] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-uuid] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-vfs] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-zptr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ztimer64] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ztimer] PASSED
✔ 01. Task 04 - Unittests on iotlab-m3 PASSED
✔ 03. Task 01 - ICMPv6 multicast echo on native PASSED
✔ 03. Task 02 - ICMPv6 link-local echo on native PASSED
✔ 03. Task 03 - ICMPv6 link-local echo on native (1 hour) PASSED
✔ 03. Task 04 - ICMPv6 stress test on native (1 hour) PASSED
✔ 03. Task 05 - ICMPv6 stress test on native (neighbor cache stress) PASSED
✔ 03. Task 06 - ICMPv6 link-local echo on native (IPv6 fragmentation) PASSED
🔁 04. Task 01 - ICMPv6 link-local echo with iotlab-m3 RERUN
✔ 04. Task 03 - ICMPv6 echo with large payload PASSED
✔ 04. Task 04 - ICMPv6 echo with iotlab-m3/samr21-xpro 15 minutes PASSED
🟡 04. Task 05 (Experimental) - ICMPv6 multicast echo with samr21-xpro/cc2538 [lille] SKIPPED
🟡 04. Task 06 (Experimental)- ICMPv6 link-local echo with samr21-xpro/cc2538 [lille] SKIPPED
🟡 04. Task 07 (Experimental) - ICMPv6 multicast echo with samr21-xpro/zero + xbee SKIPPED
🟡 04. Task 08 (Experimental) - ICMPv6 echo with samr21-xpro/zero + xbee SKIPPED
✔ 04. Task 09 - ICMPv6 stress test on iotlab-m3 PASSED
🟡 04. Task 10 (Experimental) - ICMPv6 echo with large payload (IPv6 fragmentation) SKIPPED
✔ 04. Task 11 (Experimental) - ICMPv6 stress test on nrf802154 PASSED
✔ 04. Task 12 (Experimental) - ICMPv6 multicast echo with iotlab-m3/nrf802154 PASSED
✔ 04. Task 13 (Experimental) - ICMPv6 link-local echo with iotlab-m3/nrf802154 PASSED
✔ 05. Task 01 - ICMPv6 echo unicast addresess on native (default route) PASSED
✔ 05. Task 02 - ICMPv6 echo unicast addresess on iotlab-m3 (default route) PASSED
✔ 05. Task 03 - ICMPv6 echo unicast addresess on native (specific route) PASSED
✔ 05. Task 04 - ICMPv6 echo unicast addresess on iotlab-m3 (static route) PASSED
✔ 06. Task 01 - UDP on iotlab-m3 PASSED
✔ 06. Task 02 - UDP on iotlab-m3 (UDP port compression) PASSED
✔ 06. Task 03 - UDP on native (non-existent neighbor) PASSED
✔ 06. Task 04 - UDP on iotlab-m3 (non-existent neighbor) PASSED
✔ 06. Task 05 - Empty UDP on native PASSED
✔ 06. Task 06 - Empty UDP on iotlab-m3 PASSED
✔ 07. Task 01 - ICMPv6 echo on iotlab-m3 with three hops (static route) PASSED
✔ 07. Task 02 - UDP on iotlab-m3 with three hops (static route) PASSED
✔ 07. Task 03 - ICMPv6 echo on iotlab-m3 with three hops (RPL route) PASSED
✔ 07. Task 04 - UDP on iotlab-m3 with three hops (RPL route) PASSED
🟡 07. Task 05 (Experimental) - UDP with large payload on iotlab-m3 with three hops (RPL route) SKIPPED
✔ 08. Task 01 - ICMPv6 echo between native and Linux PASSED
✔ 08. Task 08 - UDP between GNRC and lwIP on iotlab-m3 PASSED
✔ 09. Task 01 - CORD Endpoint PASSED
✔ 09. Task 02 - Confirmable retries [False-0] PASSED
✔ 09. Task 02 - Confirmable retries [True-1] PASSED
✔ 09. Task 03 - Block1 PASSED
✔ 09. Task 04 - Block2 PASSED
✔ 09. Task 05 - Observe registration and notification PASSED
✔ 10. Task 01 - Destination unreachable - no route to destination PASSED
✔ 10. Task 02 - Destination unreachable - Beyond scope of source address PASSED
✔ 10. Task 03 - Destination unreachable - address unreachable (target node address) PASSED
✔ 10. Task 04 - Destination unreachable - address unreachable (neighbor cache miss) PASSED
✔ 10. Task 05 - Destination unreachable - port unreachable PASSED
✔ 10. Task 06 - Destination unreachable - port unreachable (large payload) PASSED
✔ 10. Task 07 - Packet too big PASSED
✔ 10. Task 08 - Time exceeded - hop limit exceeded in transit PASSED
✔ 10. Task 09 - Parameter problem - erroneous header field encountered PASSED
✔ 10. Task 10 - IPv6-in-IPv6 encapsulation PASSED
✖ 11. Task 01 - LoRaWAN example FAILED
✔ 11. Task 02 - OTAA join procedure [0] PASSED
✔ 11. Task 02 - OTAA join procedure [3] PASSED
✔ 11. Task 02 - OTAA join procedure [5] PASSED
✔ 11. Task 03 - ABP join procedure [0] PASSED
✔ 11. Task 03 - ABP join procedure [3] PASSED
✔ 11. Task 03 - ABP join procedure [5] PASSED
✔ 11. Task 04 - LoRaWAN device parameters persistence PASSED
✔ 11. Task 05 - GNRC LoRaWAN (Over The Air Activation) [otaa] PASSED
🟡 11. Task 06 - GNRC LoRaWAN (ABP) [abp] SKIPPED
jia200x commented 1 year ago

This are the missing test runs from RC1:

08.interop: Task #05 - ICMPv6 echo between iotlab-m3 and Internet host through RIOT border router - PASS ``` 2023-04-18 15:31:27,567 # ping 2001:4860:4860::8844 2023-04-18 15:31:27,625 # 12 bytes from 2001:4860:4860::8844: icmp_seq=0 ttl=116 rssi=-46 dBm time=49.865 ms 2023-04-18 15:31:28,723 # 12 bytes from 2001:4860:4860::8844: icmp_seq=1 ttl=116 rssi=-46 dBm time=135.082 ms 2023-04-18 15:31:29,737 # 12 bytes from 2001:4860:4860::8844: icmp_seq=2 ttl=116 rssi=-46 dBm time=136.834 ms 2023-04-18 15:31:29,738 # 2023-04-18 15:31:29,742 # --- 2001:4860:4860::8844 PING statistics --- 2023-04-18 15:31:29,747 # 3 packets transmitted, 3 packets received, 0% packet loss 2023-04-18 15:31:29,752 # round-trip min/avg/max = 49.865/107.260/136.834 ms ```
08.interop: Task #06 - UDP between iotlab-m3 and Internet host through RIOT border router - PASS ``` socat UDP6-LISTEN:8000,reuseaddr,fork - | xxd 00000000: 0909 0909 0909 0909 0909 0909 0909 0909 ................ 00000010: 0909 0909 0909 0909 0909 0909 0909 0909 ................ 00000020: 0909 0909 0909 0909 0909 0909 0909 0909 ................ 00000030: 0909 0a0a 0a0a 0a0a 0a0a 0a0a 0a0a 0a0a ................ 00000040: 0a0a 0a0a 0a0a 0a0a 0a0a 0a0a 0a0a 0a0a ................ 00000050: 0a0a 0a0a 0a0a 0a0a 0a0a 0a0a 0a0a 0a0a ................ ```
08.interop: Task #07 - UDP between iotlab-m3 and Internet host through RIOT border router (200b payload) - PASS ``` 00000160: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c ................ 00000170: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c ................ 00000180: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c ................ 00000190: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c ................ 000001a0: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c ................ 000001b0: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c ................ 000001c0: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c ................ 000001d0: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c ................ 000001e0: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c ................ 000001f0: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c ................ 00000200: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c ................ 00000210: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c ................ 00000220: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c ................ 00000230: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c ................ 00000240: 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c 0c0c ................ ```
jia200x commented 1 year ago
11.lorawan: Task #06 - GNRC LoRaWAN (ABP) - PASS ``` applicationID:"2" applicationName:"ABP_dev" deviceName:"abo" devEUI:"6febd34b48df269e" frequency:868100000 modulation:"LORA" bandwidth:125 spreadingFactor:12 codeRate:"4/5" polarizationInversion:false adr:false dr:0 fCnt:0 fPort:1 data:"aG9sYQ==" objectJSON:"" tags: confirmedUplink:false devAddr:"01115654" publishedAt:"2023-04-20T08:22:03.285481486Z" ```
benpicco commented 1 year ago
Task #12 - ICMPv6 echo between Border Router with WiFi uplink to named Internet host - PASS ``` 2023-04-21 12:51:01,307 # > ifconfig 2023-04-21 12:51:01,311 # Iface 9 HWaddr: 3C:71:BF:9E:13:FD Channel: 1 2023-04-21 12:51:01,315 # L2-PDU:249 MTU:1280 HL:64 RTR 2023-04-21 12:51:01,319 # RTR_ADV 6LO Source address length: 6 2023-04-21 12:51:01,322 # Link type: wireless 2023-04-21 12:51:01,327 # inet6 addr: fe80::3e71:bfff:fe9e:13fd scope: link VAL 2023-04-21 12:51:01,334 # inet6 addr: 2001:9e8:143a:24fa:3e71:bfff:fe9e:13fd scope: global VAL 2023-04-21 12:51:01,337 # inet6 group: ff02::2 2023-04-21 12:51:01,340 # inet6 group: ff02::1 2023-04-21 12:51:01,343 # inet6 group: ff02::1:ff9e:13fd 2023-04-21 12:51:01,344 # 2023-04-21 12:51:01,349 # Iface 10 HWaddr: 3C:71:BF:9E:13:FC Channel: 1 Link: up 2023-04-21 12:51:01,353 # L2-PDU:1500 MTU:1492 HL:255 RTR 2023-04-21 12:51:01,356 # Source address length: 6 2023-04-21 12:51:01,359 # Link type: wireless 2023-04-21 12:51:01,365 # inet6 addr: fe80::3e71:bfff:fe9e:13fc scope: link VAL 2023-04-21 12:51:01,372 # inet6 addr: 2001:9e8:143a:2400:3e71:bfff:fe9e:13fc scope: global VAL 2023-04-21 12:51:01,375 # inet6 group: ff02::2 2023-04-21 12:51:01,377 # inet6 group: ff02::1 2023-04-21 12:51:01,381 # inet6 group: ff02::1:ff9e:13fc 2023-04-21 12:51:01,382 # 2023-04-21 12:51:04,699 # > ping 2600:: 2023-04-21 12:51:04,937 # 12 bytes from 2600::: icmp_seq=0 ttl=51 time=232.741 ms 2023-04-21 12:51:05,858 # 12 bytes from 2600::: icmp_seq=1 ttl=51 time=154.287 ms 2023-04-21 12:51:06,882 # 12 bytes from 2600::: icmp_seq=2 ttl=51 time=178.216 ms 2023-04-21 12:51:06,882 # 2023-04-21 12:51:06,885 # --- 2600:: PING statistics --- 2023-04-21 12:51:06,890 # 3 packets transmitted, 3 packets received, 0% packet loss 2023-04-21 12:51:06,894 # round-trip min/avg/max = 154.287/188.414/232.741 ms 2023-04-21 12:51:09,651 # > ping riot-os.org 2023-04-21 12:51:09,753 # 12 bytes from 2a01:4f9:1a:9508::1: icmp_seq=0 ttl=58 time=42.622 ms 2023-04-21 12:51:10,753 # 12 bytes from 2a01:4f9:1a:9508::1: icmp_seq=1 ttl=58 time=42.776 ms 2023-04-21 12:51:11,753 # 12 bytes from 2a01:4f9:1a:9508::1: icmp_seq=2 ttl=58 time=42.527 ms 2023-04-21 12:51:11,753 # 2023-04-21 12:51:11,756 # --- riot-os.org PING statistics --- 2023-04-21 12:51:11,761 # 3 packets transmitted, 3 packets received, 0% packet loss 2023-04-21 12:51:11,765 # round-trip min/avg/max = 42.527/42.641/42.776 ms ```
Task #13 - ICMPv6 echo between ESP and named Internet host through RIOT BR with 6LowPAN - PASS ``` 2023-04-21 12:51:15,737 # Iface 11 HWaddr: 82:7D:3A:7F:E0:1D Channel: 1 2023-04-21 12:51:15,740 # L2-PDU:249 MTU:1280 HL:64 RTR 2023-04-21 12:51:15,746 # RTR_ADV 6LO Source address length: 6 2023-04-21 12:51:15,748 # Link type: wireless 2023-04-21 12:51:15,754 # inet6 addr: fe80::807d:3aff:fe7f:e01d scope: link VAL 2023-04-21 12:51:15,762 # inet6 addr: 2001:9e8:143a:24fa:807d:3aff:fe7f:e01d scope: global VAL 2023-04-21 12:51:15,763 # inet6 group: ff02::2 2023-04-21 12:51:15,765 # inet6 group: ff02::1 2023-04-21 12:51:15,770 # inet6 group: ff02::1:ff7f:e01d 2023-04-21 12:51:15,773 # inet6 group: ff02::1a 2023-04-21 12:51:15,774 # 2023-04-21 12:51:15,776 # Statistics for Layer 2 2023-04-21 12:51:15,779 # RX packets 0 bytes 0 2023-04-21 12:51:15,784 # TX packets 0 (Multicast: 0) bytes 450 2023-04-21 12:51:15,787 # TX succeeded 5 errors 0 2023-04-21 12:51:15,790 # Statistics for IPv6 2023-04-21 12:51:15,793 # RX packets 5 bytes 432 2023-04-21 12:51:15,798 # TX packets 9 (Multicast: 5) bytes 658 2023-04-21 12:51:15,801 # TX succeeded 9 errors 0 2023-04-21 12:51:15,801 # 2023-04-21 12:51:22,980 # > ping 2600:: 2023-04-21 12:51:23,171 # 12 bytes from 2600::: icmp_seq=0 ttl=50 time=183.903 ms 2023-04-21 12:51:24,195 # 12 bytes from 2600::: icmp_seq=1 ttl=50 time=208.327 ms 2023-04-21 12:51:25,217 # 12 bytes from 2600::: icmp_seq=2 ttl=50 time=231.953 ms 2023-04-21 12:51:25,218 # 2023-04-21 12:51:25,220 # --- 2600:: PING statistics --- 2023-04-21 12:51:25,226 # 3 packets transmitted, 3 packets received, 0% packet loss 2023-04-21 12:51:25,231 # round-trip min/avg/max = 183.903/208.061/231.953 ms 2023-04-21 12:51:29,348 # > ping riot-os.org 2023-04-21 12:51:29,418 # 12 bytes from 2a01:4f9:1a:9508::1: icmp_seq=0 ttl=57 time=45.117 ms 2023-04-21 12:51:30,417 # 12 bytes from 2a01:4f9:1a:9508::1: icmp_seq=1 ttl=57 time=44.044 ms 2023-04-21 12:51:31,417 # 12 bytes from 2a01:4f9:1a:9508::1: icmp_seq=2 ttl=57 time=43.621 ms 2023-04-21 12:51:31,417 # 2023-04-21 12:51:31,420 # --- riot-os.org PING statistics --- 2023-04-21 12:51:31,425 # 3 packets transmitted, 3 packets received, 0% packet loss 2023-04-21 12:51:31,429 # round-trip min/avg/max = 43.621/44.260/45.117 ms ``` ``` % ping -c3 2001:9e8:143a:24fa:807d:3aff:fe7f:e01d PING 2001:9e8:143a:24fa:807d:3aff:fe7f:e01d(2001:9e8:143a:24fa:807d:3aff:fe7f:e01d) 56 data bytes 64 bytes from 2001:9e8:143a:24fa:807d:3aff:fe7f:e01d: icmp_seq=1 ttl=63 time=113 ms 64 bytes from 2001:9e8:143a:24fa:807d:3aff:fe7f:e01d: icmp_seq=2 ttl=63 time=108 ms 64 bytes from 2001:9e8:143a:24fa:807d:3aff:fe7f:e01d: icmp_seq=3 ttl=63 time=59.3 ms --- 2001:9e8:143a:24fa:807d:3aff:fe7f:e01d ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2002ms rtt min/avg/max/mdev = 59.276/93.236/112.523/24.087 ms ```
MrKevinWeiss commented 1 year ago

Closing in favor of #282