search

RIOT-OS / Release-Specs

Specification for RIOT releases and corresponding test configurations
4 stars 21 forks source link

Release 2024.10 - RC2 #313

Open benpicco opened 4 days ago

benpicco commented 4 days ago

This issue lists the status of all tests for the Release Candidate 2 of the 2024.10 release.

Specs tested:

riot-ci commented 4 days ago

Test Report

Task Outcome
✔ 01. Task 02 - Unittests on native PASSED
✔ 01. Task 03 - Unittests on native separated [tests-analog_util] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-base64] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bcd] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bhp_event] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bhp_msg] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bitfield] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-bluetil] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-checksum] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-chunked_ringbuffer] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-clif] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-coding] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-color] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-core] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-credman] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-div] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-dns_cache] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-dns_msg] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ecc] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-fib] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-fib_sr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-fmt] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-frac] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gcoap] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_ipv6] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_ipv6_hdr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_ipv6_nib] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_mac_internal] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_netif_pktq] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_sixlowpan_frag_vrb] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-gnrc_udp] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-hashes] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ieee802154] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-inet_csum] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ipv4_addr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ipv6_addr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ipv6_hdr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-kernel_defines] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-libc] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-luid] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-matstat] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-mtd] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-nanocoap] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-nanocoap_cache] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-netopt] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-netreg] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-phydat] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-pkt] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-pktbuf] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-pktqueue] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-printf_float] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-priority_pktqueue] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-rtc] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-rtt_rtc] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-saul_reg] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-seq] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sht1x] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sixlowpan] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sixlowpan_ctx] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sixlowpan_sfr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-sock_util] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-timex] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-tsrb] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-turo] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-uri_parser] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ut_process] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-uuid] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-vfs] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-zptr] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ztimer64] PASSED
✔ 01. Task 03 - Unittests on native separated [tests-ztimer] PASSED
✔ 01. Task 04 - Unittests on iotlab-m3 PASSED
✔ 03. Task 01 - ICMPv6 multicast echo on native PASSED
✔ 03. Task 02 - ICMPv6 link-local echo on native PASSED
✔ 03. Task 03 - ICMPv6 link-local echo on native (1 hour) PASSED
✔ 03. Task 04 - ICMPv6 stress test on native (1 hour) PASSED
🟡 03. Task 05 - ICMPv6 stress test on native (neighbor cache stress) SKIPPED
✔ 03. Task 06 - ICMPv6 link-local echo on native (IPv6 fragmentation) PASSED
✔ 04. Task 01 - ICMPv6 link-local echo with iotlab-m3 PASSED
✔ 04. Task 02 - ICMPv6 multicast echo with iotlab-m3/samr21-xpro PASSED
✔ 04. Task 03 - ICMPv6 echo with large payload PASSED
✔ 04. Task 04 - ICMPv6 echo with iotlab-m3/samr21-xpro 15 minutes PASSED
✖ 04. Task 05 (Experimental) - ICMPv6 multicast echo with iotlab-m3/cc2538 [strasbourg] FAILED
✔ 04. Task 06 (Experimental)- ICMPv6 link-local echo with iotlab-m3/cc2538 [strasbourg] PASSED
🟡 04. Task 07 (Experimental) - ICMPv6 multicast echo with samr21-xpro/zero + xbee SKIPPED
🟡 04. Task 08 (Experimental) - ICMPv6 echo with samr21-xpro/zero + xbee SKIPPED
✔ 04. Task 09 - ICMPv6 stress test on iotlab-m3 PASSED
✔ 04. Task 10 (Experimental) - ICMPv6 echo with large payload (IPv6 fragmentation) PASSED
✔ 04. Task 11 (Experimental) - ICMPv6 stress test on nrf802154 PASSED
✔ 04. Task 12 (Experimental) - ICMPv6 multicast echo with iotlab-m3/nrf802154 PASSED
✔ 04. Task 13 (Experimental) - ICMPv6 link-local echo with iotlab-m3/nrf802154 PASSED
✔ 05. Task 01 - ICMPv6 echo unicast addresess on native (default route) PASSED
✔ 05. Task 02 - ICMPv6 echo unicast addresess on iotlab-m3 (default route) PASSED
✔ 05. Task 03 - ICMPv6 echo unicast addresess on native (specific route) PASSED
✔ 05. Task 04 - ICMPv6 echo unicast addresess on iotlab-m3 (static route) PASSED
✔ 06. Task 01 - UDP on iotlab-m3 PASSED
✔ 06. Task 02 - UDP on iotlab-m3 (UDP port compression) PASSED
✔ 06. Task 03 - UDP on native (non-existent neighbor) PASSED
✔ 06. Task 04 - UDP on iotlab-m3 (non-existent neighbor) PASSED
✔ 06. Task 05 - Empty UDP on native PASSED
✔ 06. Task 06 - Empty UDP on iotlab-m3 PASSED
✔ 07. Task 01 - ICMPv6 echo on iotlab-m3 with three hops (static route) PASSED
✔ 07. Task 02 - UDP on iotlab-m3 with three hops (static route) PASSED
✔ 07. Task 03 - ICMPv6 echo on iotlab-m3 with three hops (RPL route) PASSED
✔ 07. Task 04 - UDP on iotlab-m3 with three hops (RPL route) PASSED
🟡 07. Task 05 (Experimental) - UDP with large payload on iotlab-m3 with three hops (RPL route) SKIPPED
✔ 08. Task 01 - ICMPv6 echo between native and Linux PASSED
✔ 08. Task 03 - ICMPv6 echo between RIOT and Contiki-NG PASSED
✔ 08. Task 08 - UDP between GNRC and lwIP on iotlab-m3 PASSED
✔ 09. Task 01 - CORD Endpoint PASSED
✔ 09. Task 02 - Confirmable retries [False-0] PASSED
✔ 09. Task 03 - Block1 PASSED
✔ 09. Task 04 - Block2 PASSED
✔ 09. Task 05 - Observe registration and notification PASSED
✔ 10. Task 01 - Destination unreachable - no route to destination PASSED
✔ 10. Task 02 - Destination unreachable - Beyond scope of source address PASSED
✔ 10. Task 03 - Destination unreachable - address unreachable (target node address) PASSED
✔ 10. Task 04 - Destination unreachable - address unreachable (neighbor cache miss) PASSED
✔ 10. Task 05 - Destination unreachable - port unreachable PASSED
✔ 10. Task 06 - Destination unreachable - port unreachable (large payload) PASSED
✔ 10. Task 07 - Packet too big PASSED
✔ 10. Task 09 - Parameter problem - erroneous header field encountered PASSED
✔ 10. Task 10 - IPv6-in-IPv6 encapsulation PASSED
✔ 11. Task 01 - LoRaWAN example PASSED
✔ 11. Task 02 - OTAA join procedure [0] PASSED
✔ 11. Task 02 - OTAA join procedure [3] PASSED
✔ 11. Task 02 - OTAA join procedure [5] PASSED
✔ 11. Task 03 - ABP join procedure [0] PASSED
✔ 11. Task 03 - ABP join procedure [3] PASSED
✔ 11. Task 03 - ABP join procedure [5] PASSED
✔ 11. Task 04 - LoRaWAN device parameters persistence PASSED
✔ 11. Task 05 - GNRC LoRaWAN (Over The Air Activation) [otaa] PASSED
🟡 11. Task 06 - GNRC LoRaWAN (ABP) [abp] SKIPPED
benpicco commented 4 days ago

Task #12 - ICMPv6 echo between Border Router with WiFi uplink to named Internet host

success ``` 2024-11-19 23:46:22,378 # ifconfig 2024-11-19 23:46:22,382 # Iface 9 HWaddr: 3C:71:BF:9E:13:FD Channel: 6 2024-11-19 23:46:22,386 # L2-PDU:249 MTU:1280 HL:64 RTR 2024-11-19 23:46:22,390 # 6LO Source address length: 6 2024-11-19 23:46:22,392 # Link type: wireless 2024-11-19 23:46:22,398 # inet6 addr: fe80::3e71:bfff:fe9e:13fd scope: link VAL 2024-11-19 23:46:22,401 # inet6 group: ff02::2 2024-11-19 23:46:22,404 # inet6 group: ff02::1 2024-11-19 23:46:22,407 # inet6 group: ff02::1:ff9e:13fd 2024-11-19 23:46:22,408 # 2024-11-19 23:46:22,413 # Iface 10 HWaddr: 3C:71:BF:9E:13:FC Channel: 6 Link: up 2024-11-19 23:46:22,417 # L2-PDU:1500 MTU:1492 HL:255 RTR 2024-11-19 23:46:22,420 # Source address length: 6 2024-11-19 23:46:22,423 # Link type: wireless 2024-11-19 23:46:22,429 # inet6 addr: fe80::3e71:bfff:fe9e:13fc scope: link VAL 2024-11-19 23:46:22,436 # inet6 addr: 2001:9e8:1415:400:3e71:bfff:fe9e:13fc scope: global VAL 2024-11-19 23:46:22,438 # inet6 group: ff02::2 2024-11-19 23:46:22,441 # inet6 group: ff02::1 2024-11-19 23:46:22,445 # inet6 group: ff02::1:ff9e:13fc 2024-11-19 23:46:22,446 # > ping 2600:: 2024-11-19 23:46:26,406 # ping 2600:: 2024-11-19 23:46:26,535 # 12 bytes from 2600::: icmp_seq=0 ttl=50 time=121.028 ms 2024-11-19 23:46:27,541 # 12 bytes from 2600::: icmp_seq=1 ttl=50 time=127.703 ms 2024-11-19 23:46:28,536 # 12 bytes from 2600::: icmp_seq=2 ttl=50 time=121.926 ms 2024-11-19 23:46:28,536 # 2024-11-19 23:46:28,538 # --- 2600:: PING statistics --- 2024-11-19 23:46:28,543 # 3 packets transmitted, 3 packets received, 0% packet loss 2024-11-19 23:46:28,548 # round-trip min/avg/max = 121.028/123.552/127.703 ms > ping riot-os.org 2024-11-19 23:46:29,803 # ping riot-os.org 2024-11-19 23:46:29,916 # 12 bytes from 2a01:4f9:1a:9508::1: icmp_seq=0 ttl=56 time=46.212 ms 2024-11-19 23:46:30,914 # 12 bytes from 2a01:4f9:1a:9508::1: icmp_seq=1 ttl=56 time=45.931 ms 2024-11-19 23:46:31,910 # 12 bytes from 2a01:4f9:1a:9508::1: icmp_seq=2 ttl=56 time=41.927 ms 2024-11-19 23:46:31,910 # 2024-11-19 23:46:31,913 # --- riot-os.org PING statistics --- 2024-11-19 23:46:31,918 # 3 packets transmitted, 3 packets received, 0% packet loss 2024-11-19 23:46:31,922 # round-trip min/avg/max = 41.927/44.690/46.212 ms ```

Task #13 - ICMPv6 echo between ESP and named Internet host through RIOT BR with 6LowPAN

success ``` 2024-11-19 23:47:39,727 # Iface 11 HWaddr: EE:FA:BC:5F:7E:5F Channel: 6 2024-11-19 23:47:39,729 # L2-PDU:249 MTU:1280 HL:64 RTR 2024-11-19 23:47:39,735 # RTR_ADV 6LO Source address length: 6 2024-11-19 23:47:39,738 # Link type: wireless 2024-11-19 23:47:39,743 # inet6 addr: fe80::ecfa:bcff:fe5f:7e5f scope: link VAL 2024-11-19 23:47:39,749 # inet6 addr: 2001:9e8:1415:4ff:ecfa:bcff:fe5f:7e5f scope: global VAL 2024-11-19 23:47:39,752 # inet6 group: ff02::2 2024-11-19 23:47:39,754 # inet6 group: ff02::1 2024-11-19 23:47:39,760 # inet6 group: ff02::1:ff5f:7e5f 2024-11-19 23:47:39,763 # inet6 group: ff02::1a 2024-11-19 23:47:39,763 # 2024-11-19 23:47:39,765 # Statistics for Layer 2 2024-11-19 23:47:39,768 # RX packets 0 bytes 0 2024-11-19 23:47:39,774 # TX packets 0 (Multicast: 0) bytes 148 2024-11-19 23:47:39,776 # TX succeeded 2 errors 0 2024-11-19 23:47:39,779 # Statistics for IPv6 2024-11-19 23:47:39,782 # RX packets 2 bytes 240 2024-11-19 23:47:39,788 # TX packets 4 (Multicast: 3) bytes 250 2024-11-19 23:47:39,790 # TX succeeded 4 errors 0 2024-11-19 23:47:57,230 # ping 2600:: 2024-11-19 23:47:57,461 # 12 bytes from 2600::: icmp_seq=0 ttl=49 time=224.909 ms 2024-11-19 23:47:58,380 # 12 bytes from 2600::: icmp_seq=1 ttl=49 time=143.979 ms 2024-11-19 23:47:59,406 # 12 bytes from 2600::: icmp_seq=2 ttl=49 time=170.212 ms 2024-11-19 23:47:59,406 # 2024-11-19 23:47:59,408 # --- 2600:: PING statistics --- 2024-11-19 23:47:59,414 # 3 packets transmitted, 3 packets received, 0% packet loss 2024-11-19 23:47:59,419 # round-trip min/avg/max = 143.979/179.700/224.909 ms > ping riot-os.org 2024-11-19 23:48:02,227 # ping riot-os.org 2024-11-19 23:48:02,312 # 12 bytes from 2a01:4f9:1a:9508::1: icmp_seq=0 ttl=55 time=54.329 ms 2024-11-19 23:48:03,311 # 12 bytes from 2a01:4f9:1a:9508::1: icmp_seq=1 ttl=55 time=52.569 ms 2024-11-19 23:48:04,320 # 12 bytes from 2a01:4f9:1a:9508::1: icmp_seq=2 ttl=55 time=61.436 ms 2024-11-19 23:48:04,320 # 2024-11-19 23:48:04,323 # --- riot-os.org PING statistics --- 2024-11-19 23:48:04,328 # 3 packets transmitted, 3 packets received, 0% packet loss 2024-11-19 23:48:04,332 # round-trip min/avg/max = 52.569/56.111/61.436 ms ```