RIOT-OS / Release-Specs

Specification for RIOT releases and corresponding test configurations
4 stars 21 forks source link

Release 2022.04 - RC7 #248

Closed OlegHahm closed 2 years ago

OlegHahm commented 2 years ago

This issue lists the status of all tests for the Release Candidate 7 of the 2022.04 release.

Specs tested:

OlegHahm commented 2 years ago

@benpicco, care to run the previously failing ESP32 interop tests again?

riot-ci commented 2 years ago

Test Report

Task Outcome
01. Task 02 - Unittests on native PASSED
01. Task 03 - Unittests on native separated [tests-analog_util] PASSED
01. Task 03 - Unittests on native separated [tests-base64] PASSED
01. Task 03 - Unittests on native separated [tests-bcd] PASSED
01. Task 03 - Unittests on native separated [tests-bitfield] PASSED
01. Task 03 - Unittests on native separated [tests-bloom] PASSED
01. Task 03 - Unittests on native separated [tests-bluetil] PASSED
01. Task 03 - Unittests on native separated [tests-checksum] PASSED
01. Task 03 - Unittests on native separated [tests-chunked_ringbuffer] PASSED
01. Task 03 - Unittests on native separated [tests-clif] PASSED
01. Task 03 - Unittests on native separated [tests-color] PASSED
01. Task 03 - Unittests on native separated [tests-core] PASSED
01. Task 03 - Unittests on native separated [tests-credman] PASSED
01. Task 03 - Unittests on native separated [tests-div] PASSED
01. Task 03 - Unittests on native separated [tests-ecc] PASSED
01. Task 03 - Unittests on native separated [tests-fib] PASSED
01. Task 03 - Unittests on native separated [tests-fib_sr] PASSED
01. Task 03 - Unittests on native separated [tests-fmt] PASSED
01. Task 03 - Unittests on native separated [tests-frac] PASSED
01. Task 03 - Unittests on native separated [tests-gcoap] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_ipv6] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_ipv6_hdr] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_ipv6_nib] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_mac_internal] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_netif_pktq] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_sixlowpan_frag_vrb] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_udp] PASSED
01. Task 03 - Unittests on native separated [tests-hashes] PASSED
01. Task 03 - Unittests on native separated [tests-ieee802154] PASSED
01. Task 03 - Unittests on native separated [tests-inet_csum] PASSED
01. Task 03 - Unittests on native separated [tests-ipv4_addr] PASSED
01. Task 03 - Unittests on native separated [tests-ipv6_addr] PASSED
01. Task 03 - Unittests on native separated [tests-ipv6_hdr] PASSED
01. Task 03 - Unittests on native separated [tests-kernel_defines] PASSED
01. Task 03 - Unittests on native separated [tests-luid] PASSED
01. Task 03 - Unittests on native separated [tests-matstat] PASSED
01. Task 03 - Unittests on native separated [tests-mtd] PASSED
01. Task 03 - Unittests on native separated [tests-nanocoap] PASSED
01. Task 03 - Unittests on native separated [tests-netopt] PASSED
01. Task 03 - Unittests on native separated [tests-netreg] PASSED
01. Task 03 - Unittests on native separated [tests-phydat] PASSED
01. Task 03 - Unittests on native separated [tests-pkt] PASSED
01. Task 03 - Unittests on native separated [tests-pktbuf] PASSED
01. Task 03 - Unittests on native separated [tests-pktqueue] PASSED
01. Task 03 - Unittests on native separated [tests-printf_float] PASSED
01. Task 03 - Unittests on native separated [tests-rtc] PASSED
01. Task 03 - Unittests on native separated [tests-rtt_rtc] PASSED
01. Task 03 - Unittests on native separated [tests-saul_reg] PASSED
01. Task 03 - Unittests on native separated [tests-scanf_float] PASSED
01. Task 03 - Unittests on native separated [tests-seq] PASSED
01. Task 03 - Unittests on native separated [tests-sht1x] PASSED
01. Task 03 - Unittests on native separated [tests-sixlowpan] PASSED
01. Task 03 - Unittests on native separated [tests-sixlowpan_ctx] PASSED
01. Task 03 - Unittests on native separated [tests-sixlowpan_sfr] PASSED
01. Task 03 - Unittests on native separated [tests-sock_util] PASSED
01. Task 03 - Unittests on native separated [tests-timex] PASSED
01. Task 03 - Unittests on native separated [tests-tsrb] PASSED
01. Task 03 - Unittests on native separated [tests-turo] PASSED
01. Task 03 - Unittests on native separated [tests-uri_parser] PASSED
01. Task 03 - Unittests on native separated [tests-ut_process] PASSED
01. Task 03 - Unittests on native separated [tests-uuid] PASSED
01. Task 03 - Unittests on native separated [tests-vfs] PASSED
01. Task 03 - Unittests on native separated [tests-zptr] PASSED
01. Task 03 - Unittests on native separated [tests-ztimer64] PASSED
01. Task 03 - Unittests on native separated [tests-ztimer] PASSED
03. Task 01 - ICMPv6 multicast echo on native PASSED
03. Task 02 - ICMPv6 link-local echo on native PASSED
03. Task 03 - ICMPv6 link-local echo on native (1 hour) PASSED
03. Task 04 - ICMPv6 stress test on native (1 hour) PASSED
03. Task 05 - ICMPv6 stress test on native (neighbor cache stress) PASSED
03. Task 06 - ICMPv6 link-local echo on native (IPv6 fragmentation) PASSED
🟡 04. Task 07 (Experimental) - ICMPv6 multicast echo with samr21-xpro/zero + xbee SKIPPED
🟡 04. Task 08 (Experimental) - ICMPv6 echo with samr21-xpro/zero + xbee SKIPPED
05. Task 01 - ICMPv6 echo unicast addresess on native (default route) PASSED
05. Task 03 - ICMPv6 echo unicast addresess on native (specific route) PASSED
05. Task 04 - ICMPv6 echo unicast addresess on iotlab-m3 (static route) PASSED
06. Task 03 - UDP on native (non-existent neighbor) PASSED
06. Task 05 - Empty UDP on native PASSED
08. Task 01 - ICMPv6 echo between native and Linux PASSED
09. Task 01 - CORD Endpoint PASSED
09. Task 02 - Confirmable retries [False-0] PASSED
09. Task 02 - Confirmable retries [True-1] PASSED
09. Task 03 - Block1 PASSED
09. Task 04 - Block2 PASSED
09. Task 05 - Observe registration and notification PASSED
10. Task 01 - Destination unreachable - no route to destination PASSED
10. Task 02 - Destination unreachable - Beyond scope of source address PASSED
10. Task 03 - Destination unreachable - address unreachable (target node address) PASSED
10. Task 04 - Destination unreachable - address unreachable (neighbor cache miss) PASSED
10. Task 05 - Destination unreachable - port unreachable PASSED
10. Task 06 - Destination unreachable - port unreachable (large payload) PASSED
10. Task 07 - Packet too big PASSED
10. Task 08 - Time exceeded - hop limit exceeded in transit PASSED
10. Task 09 - Parameter problem - erroneous header field encountered PASSED
10. Task 10 - IPv6-in-IPv6 encapsulation PASSED
benpicco commented 2 years ago

Task #12 - ICMPv6 echo between Border Router with WiFi uplink to named Internet host

passed (esp32-wroom-32) ``` 2022-04-30 12:21:21,859 # ifconfig 2022-04-30 12:21:21,864 # Iface 9 HWaddr: 3C:71:BF:9E:13:FC Channel: 6 Link: up 2022-04-30 12:21:21,868 # L2-PDU:1500 MTU:1492 HL:255 RTR 2022-04-30 12:21:21,871 # Source address length: 6 2022-04-30 12:21:21,874 # Link type: wireless 2022-04-30 12:21:21,880 # inet6 addr: fe80::3e71:bfff:fe9e:13fc scope: link VAL 2022-04-30 12:21:21,887 # inet6 addr: 2001:16b8:45bf:2a00:3e71:bfff:fe9e:13fc scope: global VAL 2022-04-30 12:21:21,890 # inet6 group: ff02::2 2022-04-30 12:21:21,892 # inet6 group: ff02::1 2022-04-30 12:21:21,896 # inet6 group: ff02::1:ff9e:13fc 2022-04-30 12:21:21,897 # 2022-04-30 12:21:21,901 # Iface 8 HWaddr: 3C:71:BF:9E:13:FD Channel: 6 2022-04-30 12:21:21,905 # L2-PDU:249 MTU:1280 HL:64 RTR 2022-04-30 12:21:21,909 # RTR_ADV 6LO Source address length: 6 2022-04-30 12:21:21,912 # Link type: wireless 2022-04-30 12:21:21,917 # inet6 addr: fe80::3e71:bfff:fe9e:13fd scope: link VAL 2022-04-30 12:21:21,924 # inet6 addr: 2001:16b8:45bf:2afc:3e71:bfff:fe9e:13fd scope: global VAL 2022-04-30 12:21:21,927 # inet6 group: ff02::2 2022-04-30 12:21:21,930 # inet6 group: ff02::1 2022-04-30 12:21:21,933 # inet6 group: ff02::1:ff9e:13fd 2022-04-30 12:21:21,934 # > ping 2600:: 2022-04-30 12:21:26,691 # ping 2600:: 2022-04-30 12:21:26,937 # 12 bytes from 2600::: icmp_seq=0 ttl=53 time=240.867 ms 2022-04-30 12:21:27,855 # 12 bytes from 2600::: icmp_seq=1 ttl=53 time=158.351 ms 2022-04-30 12:21:28,880 # 12 bytes from 2600::: icmp_seq=2 ttl=53 time=183.702 ms 2022-04-30 12:21:28,881 # 2022-04-30 12:21:28,883 # --- 2600:: PING statistics --- 2022-04-30 12:21:28,888 # 3 packets transmitted, 3 packets received, 0% packet loss 2022-04-30 12:21:28,892 # round-trip min/avg/max = 158.351/194.306/240.867 ms > ping riot-os.org 2022-04-30 12:21:32,379 # ping riot-os.org 2022-04-30 12:21:32,594 # 12 bytes from 2001:67c:254:b0b0::1: icmp_seq=0 ttl=60 time=26.780 ms 2022-04-30 12:21:33,593 # 12 bytes from 2001:67c:254:b0b0::1: icmp_seq=1 ttl=60 time=25.647 ms 2022-04-30 12:21:34,589 # 12 bytes from 2001:67c:254:b0b0::1: icmp_seq=2 ttl=60 time=21.515 ms 2022-04-30 12:21:34,589 # 2022-04-30 12:21:34,592 # --- riot-os.org PING statistics --- 2022-04-30 12:21:34,597 # 3 packets transmitted, 3 packets received, 0% packet loss 2022-04-30 12:21:34,601 # round-trip min/avg/max = 21.515/24.647/26.780 ms ```
passed (esp8266-esp-12x) ``` 2022-04-30 12:21:37,190 # ifconfig 2022-04-30 12:21:37,193 # Iface 11 HWaddr: 82:7D:3A:7F:E0:1D Channel: 6 2022-04-30 12:21:37,198 # L2-PDU:249 MTU:1280 HL:64 RTR 2022-04-30 12:21:37,201 # RTR_ADV 6LO Source address length: 6 2022-04-30 12:21:37,204 # Link type: wireless 2022-04-30 12:21:37,210 # inet6 addr: fe80::807d:3aff:fe7f:e01d scope: link VAL 2022-04-30 12:21:37,217 # inet6 addr: 2001:16b8:45bf:2afc:807d:3aff:fe7f:e01d scope: global VAL 2022-04-30 12:21:37,220 # inet6 group: ff02::2 2022-04-30 12:21:37,223 # inet6 group: ff02::1 2022-04-30 12:21:37,226 # inet6 group: ff02::1:ff7f:e01d 2022-04-30 12:21:37,229 # inet6 group: ff02::1a 2022-04-30 12:21:37,229 # 2022-04-30 12:21:37,232 # Statistics for Layer 2 2022-04-30 12:21:37,237 # RX packets 0 bytes 0 2022-04-30 12:21:37,240 # TX packets 0 (Multicast: 0) bytes 472 2022-04-30 12:21:37,242 # TX succeeded 4 errors 0 2022-04-30 12:21:37,245 # Statistics for IPv6 2022-04-30 12:21:37,248 # RX packets 4 bytes 352 2022-04-30 12:21:37,254 # TX packets 6 (Multicast: 3) bytes 570 2022-04-30 12:21:37,258 # TX succeeded 6 errors 0 2022-04-30 12:21:37,258 # > ping 2600:: 2022-04-30 12:21:41,052 # ping 2600:: 2022-04-30 12:21:41,277 # 12 bytes from 2600::: icmp_seq=0 ttl=52 time=218.080 ms 2022-04-30 12:21:42,306 # 12 bytes from 2600::: icmp_seq=1 ttl=52 time=247.556 ms 2022-04-30 12:21:43,227 # 12 bytes from 2600::: icmp_seq=2 ttl=52 time=169.065 ms 2022-04-30 12:21:43,227 # 2022-04-30 12:21:43,229 # --- 2600:: PING statistics --- 2022-04-30 12:21:43,235 # 3 packets transmitted, 3 packets received, 0% packet loss 2022-04-30 12:21:43,240 # round-trip min/avg/max = 169.065/211.567/247.556 ms > ping riot-os.org 2022-04-30 12:21:46,761 # ping riot-os.org 2022-04-30 12:21:46,814 # 12 bytes from 2001:67c:254:b0b0::1: icmp_seq=0 ttl=59 time=29.421 ms 2022-04-30 12:21:47,812 # 12 bytes from 2001:67c:254:b0b0::1: icmp_seq=1 ttl=59 time=27.741 ms 2022-04-30 12:21:48,816 # 12 bytes from 2001:67c:254:b0b0::1: icmp_seq=2 ttl=59 time=31.201 ms 2022-04-30 12:21:48,816 # 2022-04-30 12:21:48,819 # --- riot-os.org PING statistics --- 2022-04-30 12:21:48,824 # 3 packets transmitted, 3 packets received, 0% packet loss 2022-04-30 12:21:48,828 # round-trip min/avg/max = 27.741/29.454/31.201 ms ```