search

RIOT-OS / Release-Specs

Specification for RIOT releases and corresponding test configurations
4 stars 21 forks source link

Release 2021.10 - RC2 #237

Closed benpicco closed 2 years ago

benpicco commented 2 years ago

This issue lists the status of all tests for the Release Candidate 2 of the 2021.10 release.

Specs tested:

riot-ci commented 2 years ago

Test Report

Task Outcome
✔ 01. Task 02 - Unittests on native PASSED
✔ 01. Task 03 - Unittests on native separated [tests-analog_util] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-base64] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bcd] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bitfield] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bloom] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bluetil] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-clif] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-color] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-core] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-credman] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-div] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ecc] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-fib] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-fib_sr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-fmt] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-frac] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gcoap] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_ipv6] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_ipv6_hdr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_ipv6_nib] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_mac_internal] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_netif_pktq] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_sixlowpan_frag_vrb] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_udp] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-hashes] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ieee802154] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-inet_csum] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ipv4_addr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ipv6_addr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ipv6_hdr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-kernel_defines] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-luid] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-matstat] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-mtd] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-nanocoap] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-netreg] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-phydat] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-pkt] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-pktbuf] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-pktqueue] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-printf_float] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-priority_pktqueue] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-rtc] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-rtt_rtc] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-saul_reg] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-scanf_float] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-seq] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sht1x] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sixlowpan] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sixlowpan_ctx] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sixlowpan_sfr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sock_util] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-timex] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-tsrb] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-turo] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-uri_parser] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ut_process] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-uuid] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-vfs] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-zptr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ztimer] PASSED
✔ 01. Task 04 - Unittests on iotlab-m3 PASSED
✔ 03. Task 01 - ICMPv6 multicast echo on native PASSED
✔ 03. Task 02 - ICMPv6 link-local echo on native PASSED
✔ 03. Task 03 - ICMPv6 link-local echo on native (1 hour) PASSED
✔ 03. Task 04 - ICMPv6 stress test on native (1 hour) PASSED
✔ 03. Task 05 - ICMPv6 stress test on native (neighbor cache stress) PASSED
✔ 03. Task 06 - ICMPv6 link-local echo on native (IPv6 fragmentation) PASSED
✔ 04. Task 01 - ICMPv6 link-local echo with iotlab-m3 PASSED
✔ 04. Task 02 - ICMPv6 multicast echo with iotlab-m3/samr21-xpro PASSED
✔ 04. Task 03 - ICMPv6 echo with large payload PASSED
✔ 04. Task 04 - ICMPv6 echo with iotlab-m3/samr21-xpro 15 minutes PASSED
✖ 04. Task 05 (Experimental) - ICMPv6 multicast echo with samr21-xpro/cc2538 [lille] FAILED
✖ 04. Task 06 (Experimental)- ICMPv6 link-local echo with samr21-xpro/cc2538 [lille] FAILED
🟡 04. Task 07 (Experimental) - ICMPv6 multicast echo with samr21-xpro/zero + xbee SKIPPED
🟡 04. Task 08 (Experimental) - ICMPv6 echo with samr21-xpro/zero + xbee SKIPPED
✔ 04. Task 09 - ICMPv6 stress test on iotlab-m3 PASSED
✔ 04. Task 10 (Experimental) - ICMPv6 echo with large payload (IPv6 fragmentation) PASSED
✔ 04. Task 11 (Experimental) - ICMPv6 stress test on nrf802154 PASSED
✔ 04. Task 12 (Experimental) - ICMPv6 multicast echo with iotlab-m3/nrf802154 PASSED
✖ 04. Task 13 (Experimental) - ICMPv6 link-local echo with iotlab-m3/nrf802154 FAILED
✔ 05. Task 01 - ICMPv6 echo unicast addresess on native (default route) PASSED
✔ 05. Task 02 - ICMPv6 echo unicast addresess on iotlab-m3 (default route) PASSED
✔ 05. Task 03 - ICMPv6 echo unicast addresess on native (specific route) PASSED
✔ 05. Task 04 - ICMPv6 echo unicast addresess on iotlab-m3 (static route) PASSED
✔ 06. Task 01 - UDP on iotlab-m3 PASSED
✔ 06. Task 02 - UDP on iotlab-m3 (UDP port compression) PASSED
✔ 06. Task 03 - UDP on native (non-existent neighbor) PASSED
✔ 06. Task 04 - UDP on iotlab-m3 (non-existent neighbor) PASSED
✔ 06. Task 05 - Empty UDP on native PASSED
✔ 06. Task 06 - Empty UDP on iotlab-m3 PASSED
✔ 07. Task 01 - ICMPv6 echo on iotlab-m3 with three hops (static route) PASSED
✔ 07. Task 02 - UDP on iotlab-m3 with three hops (static route) PASSED
✔ 07. Task 03 - ICMPv6 echo on iotlab-m3 with three hops (RPL route) PASSED
✔ 07. Task 04 - UDP on iotlab-m3 with three hops (RPL route) PASSED
🟡 07. Task 05 (Experimental) - UDP with large payload on iotlab-m3 with three hops (RPL route) SKIPPED
✔ 08. Task 01 - ICMPv6 echo between native and Linux PASSED
✔ 08. Task 08 - UDP between GNRC and lwIP on iotlab-m3 PASSED
✔ 09. Task 01 - CORD Endpoint PASSED
✔ 09. Task 02 - Confirmable retries [False-0] PASSED
✔ 09. Task 02 - Confirmable retries [True-1] PASSED
✔ 09. Task 03 - Block1 PASSED
✔ 09. Task 04 - Block2 PASSED
✔ 09. Task 05 - Observe registration and notification PASSED
✔ 10. Task 01 - Destination unreachable - no route to destination PASSED
✔ 10. Task 02 - Destination unreachable - Beyond scope of source address PASSED
✔ 10. Task 03 - Destination unreachable - address unreachable (target node address) PASSED
✔ 10. Task 04 - Destination unreachable - address unreachable (neighbor cache miss) PASSED
✔ 10. Task 05 - Destination unreachable - port unreachable PASSED
✔ 10. Task 06 - Destination unreachable - port unreachable (large payload) PASSED
✔ 10. Task 07 - Packet too big PASSED
✔ 10. Task 08 - Time exceeded - hop limit exceeded in transit PASSED
✔ 10. Task 09 - Parameter problem - erroneous header field encountered PASSED
✔ 10. Task 10 - IPv6-in-IPv6 encapsulation PASSED
✖ 11. Task 05 - GNRC LoRaWAN (Over The Air Activation) [otaa] FAILED
✖ 11. Task 06 - GNRC LoRaWAN (ABP) [abp] FAILED
benpicco commented 2 years ago

Task #12 - ICMPv6 echo between Border Router with WiFi uplink to named Internet host

success ``` 2021-10-19 23:03:23,700 # ifconfig 2021-10-19 23:03:23,707 # Iface 9 HWaddr: 3C:71:BF:9E:13:FC Channel: 6 Link: up 2021-10-19 23:03:23,711 # L2-PDU:1500 MTU:1492 HL:255 RTR 2021-10-19 23:03:23,714 # Source address length: 6 2021-10-19 23:03:23,717 # Link type: wireless 2021-10-19 23:03:23,723 # inet6 addr: fe80::3e71:bfff:fe9e:13fc scope: link VAL 2021-10-19 23:03:23,730 # inet6 addr: 2001:16b8:45a5:2a00:3e71:bfff:fe9e:13fc scope: global VAL 2021-10-19 23:03:23,733 # inet6 group: ff02::2 2021-10-19 23:03:23,735 # inet6 group: ff02::1 2021-10-19 23:03:23,739 # inet6 group: ff02::1:ff9e:13fc 2021-10-19 23:03:23,740 # 2021-10-19 23:03:23,744 # Iface 8 HWaddr: 3C:71:BF:9E:13:FD Channel: 6 2021-10-19 23:03:23,748 # L2-PDU:249 MTU:1280 HL:64 RTR 2021-10-19 23:03:23,752 # RTR_ADV 6LO Source address length: 6 2021-10-19 23:03:23,755 # Link type: wireless 2021-10-19 23:03:23,760 # inet6 addr: fe80::3e71:bfff:fe9e:13fd scope: link VAL 2021-10-19 23:03:23,768 # inet6 addr: 2001:16b8:45a5:2afc:3e71:bfff:fe9e:13fd scope: global VAL 2021-10-19 23:03:23,771 # inet6 group: ff02::2 2021-10-19 23:03:23,773 # inet6 group: ff02::1 2021-10-19 23:03:23,777 # inet6 group: ff02::1:ff9e:13fd 2021-10-19 23:03:23,778 # > ping6 2600:: 2021-10-19 23:03:27,852 # ping6 2600:: 2021-10-19 23:03:28,021 # 12 bytes from 2600::: icmp_seq=0 ttl=53 time=163.167 ms 2021-10-19 23:03:29,040 # 12 bytes from 2600::: icmp_seq=1 ttl=53 time=182.210 ms 2021-10-19 23:03:30,063 # 12 bytes from 2600::: icmp_seq=2 ttl=53 time=204.429 ms 2021-10-19 23:03:30,063 # 2021-10-19 23:03:30,065 # --- 2600:: PING statistics --- 2021-10-19 23:03:30,070 # 3 packets transmitted, 3 packets received, 0% packet loss 2021-10-19 23:03:30,075 # round-trip min/avg/max = 163.167/183.268/204.429 ms > ping6 riot-os.org 2021-10-19 23:03:31,844 # ping6 riot-os.org 2021-10-19 23:03:31,923 # 12 bytes from 2001:67c:254:b0b0::1: icmp_seq=0 ttl=57 time=21.991 ms 2021-10-19 23:03:32,931 # 12 bytes from 2001:67c:254:b0b0::1: icmp_seq=1 ttl=57 time=30.426 ms 2021-10-19 23:03:33,930 # 12 bytes from 2001:67c:254:b0b0::1: icmp_seq=2 ttl=57 time=29.191 ms 2021-10-19 23:03:33,931 # 2021-10-19 23:03:33,933 # --- riot-os.org PING statistics --- 2021-10-19 23:03:33,938 # 3 packets transmitted, 3 packets received, 0% packet loss 2021-10-19 23:03:33,942 # round-trip min/avg/max = 21.991/27.202/30.426 ms ```

Task #13 - ICMPv6 echo between ESP and named Internet host through Linux with 6LowPAN

success ``` 2021-10-19 23:08:03,543 # Iface 11 HWaddr: 82:7D:3A:7F:E0:1D Channel: 6 2021-10-19 23:08:03,548 # L2-PDU:249 MTU:1280 HL:64 RTR 2021-10-19 23:08:03,551 # RTR_ADV 6LO Source address length: 6 2021-10-19 23:08:03,554 # Link type: wireless 2021-10-19 23:08:03,559 # inet6 addr: fe80::807d:3aff:fe7f:e01d scope: link VAL 2021-10-19 23:08:03,567 # inet6 addr: 2001:16b8:45a5:2afc:807d:3aff:fe7f:e01d scope: global VAL 2021-10-19 23:08:03,570 # inet6 group: ff02::2 2021-10-19 23:08:03,573 # inet6 group: ff02::1 2021-10-19 23:08:03,576 # inet6 group: ff02::1:ff7f:e01d 2021-10-19 23:08:03,576 # 2021-10-19 23:08:03,579 # Statistics for Layer 2 2021-10-19 23:08:03,584 # RX packets 0 bytes 0 2021-10-19 23:08:03,587 # TX packets 0 (Multicast: 0) bytes 214 2021-10-19 23:08:03,590 # TX succeeded 3 errors 0 2021-10-19 23:08:03,593 # Statistics for IPv6 2021-10-19 23:08:03,595 # RX packets 3 bytes 312 2021-10-19 23:08:03,601 # TX packets 4 (Multicast: 2) bytes 264 2021-10-19 23:08:03,604 # TX succeeded 4 errors 0 2021-10-19 23:08:03,605 # 2021-10-19 23:08:33,530 # ping 2600:: 2021-10-19 23:08:33,695 # 12 bytes from 2600::: icmp_seq=0 ttl=52 time=158.980 ms 2021-10-19 23:08:33,889 # scandone 2021-10-19 23:08:34,717 # 12 bytes from 2600::: icmp_seq=1 ttl=52 time=180.156 ms 2021-10-19 23:08:35,738 # 12 bytes from 2600::: icmp_seq=2 ttl=52 time=202.993 ms 2021-10-19 23:08:35,739 # 2021-10-19 23:08:35,741 # --- 2600:: PING statistics --- 2021-10-19 23:08:35,747 # 3 packets transmitted, 3 packets received, 0% packet loss 2021-10-19 23:08:35,752 # round-trip min/avg/max = 158.980/180.709/202.993 ms > ping riot-os.org 2021-10-19 23:08:42,810 # ping riot-os.org 2021-10-19 23:08:42,866 # 12 bytes from 2001:67c:254:b0b0::1: icmp_seq=0 ttl=56 time=32.653 ms 2021-10-19 23:08:43,862 # 12 bytes from 2001:67c:254:b0b0::1: icmp_seq=1 ttl=56 time=29.102 ms 2021-10-19 23:08:43,890 # scandone 2021-10-19 23:08:44,868 # 12 bytes from 2001:67c:254:b0b0::1: icmp_seq=2 ttl=56 time=33.887 ms 2021-10-19 23:08:44,868 # 2021-10-19 23:08:44,871 # --- riot-os.org PING statistics --- 2021-10-19 23:08:44,876 # 3 packets transmitted, 3 packets received, 0% packet loss 2021-10-19 23:08:44,880 # round-trip min/avg/max = 29.102/31.880/33.887 ms ```
fjmolinas commented 2 years ago

Most LoRaWAN fixes where not yet backported to this RC, I don't think it makes sense to run them until RC3.

benpicco commented 2 years ago

Closing in favor of #238