RIOT-OS / Release-Specs

Specification for RIOT releases and corresponding test configurations
4 stars 21 forks source link

Release 2022.10 - RC3 #266

Closed maribu closed 1 year ago

maribu commented 1 year ago

This issue lists the status of all tests for the Release Candidate 3 of the 2022.10 release.

Specs tested:

maribu commented 1 year ago

IMO https://github.com/RIOT-OS/Release-Specs/issues/264#issuecomment-1313571914 is still valid, as the changes since RC2 have a close to zero chance to break things. I ticked task 8.11 therefore.

riot-ci commented 1 year ago

Test Report

Task Outcome
01. Task 02 - Unittests on native PASSED
01. Task 03 - Unittests on native separated [tests-analog_util] PASSED
01. Task 03 - Unittests on native separated [tests-base64] PASSED
01. Task 03 - Unittests on native separated [tests-bcd] PASSED
01. Task 03 - Unittests on native separated [tests-bhp_event] PASSED
01. Task 03 - Unittests on native separated [tests-bhp_msg] PASSED
01. Task 03 - Unittests on native separated [tests-bitfield] PASSED
01. Task 03 - Unittests on native separated [tests-bloom] PASSED
01. Task 03 - Unittests on native separated [tests-bluetil] PASSED
01. Task 03 - Unittests on native separated [tests-checksum] PASSED
01. Task 03 - Unittests on native separated [tests-clif] PASSED
01. Task 03 - Unittests on native separated [tests-color] PASSED
01. Task 03 - Unittests on native separated [tests-core] PASSED
01. Task 03 - Unittests on native separated [tests-credman] PASSED
01. Task 03 - Unittests on native separated [tests-div] PASSED
01. Task 03 - Unittests on native separated [tests-dns_cache] PASSED
01. Task 03 - Unittests on native separated [tests-ecc] PASSED
01. Task 03 - Unittests on native separated [tests-fib] PASSED
01. Task 03 - Unittests on native separated [tests-fib_sr] PASSED
01. Task 03 - Unittests on native separated [tests-fmt] PASSED
01. Task 03 - Unittests on native separated [tests-frac] PASSED
01. Task 03 - Unittests on native separated [tests-gcoap] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_ipv6] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_ipv6_hdr] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_ipv6_nib] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_mac_internal] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_netif_pktq] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_sixlowpan_frag_vrb] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_udp] PASSED
01. Task 03 - Unittests on native separated [tests-hashes] PASSED
01. Task 03 - Unittests on native separated [tests-ieee802154] PASSED
01. Task 03 - Unittests on native separated [tests-inet_csum] PASSED
01. Task 03 - Unittests on native separated [tests-ipv4_addr] PASSED
01. Task 03 - Unittests on native separated [tests-ipv6_addr] PASSED
01. Task 03 - Unittests on native separated [tests-ipv6_hdr] PASSED
01. Task 03 - Unittests on native separated [tests-kernel_defines] PASSED
01. Task 03 - Unittests on native separated [tests-libc] PASSED
01. Task 03 - Unittests on native separated [tests-luid] PASSED
01. Task 03 - Unittests on native separated [tests-matstat] PASSED
01. Task 03 - Unittests on native separated [tests-mtd] PASSED
01. Task 03 - Unittests on native separated [tests-nanocoap] PASSED
01. Task 03 - Unittests on native separated [tests-nanocoap_cache] PASSED
01. Task 03 - Unittests on native separated [tests-netopt] PASSED
01. Task 03 - Unittests on native separated [tests-netreg] PASSED
01. Task 03 - Unittests on native separated [tests-phydat] PASSED
01. Task 03 - Unittests on native separated [tests-pkt] PASSED
01. Task 03 - Unittests on native separated [tests-pktbuf] PASSED
01. Task 03 - Unittests on native separated [tests-pktqueue] PASSED
01. Task 03 - Unittests on native separated [tests-printf_float] PASSED
01. Task 03 - Unittests on native separated [tests-priority_pktqueue] PASSED
01. Task 03 - Unittests on native separated [tests-rtc] PASSED
01. Task 03 - Unittests on native separated [tests-rtt_rtc] PASSED
01. Task 03 - Unittests on native separated [tests-saul_reg] PASSED
01. Task 03 - Unittests on native separated [tests-scanf_float] PASSED
01. Task 03 - Unittests on native separated [tests-seq] PASSED
01. Task 03 - Unittests on native separated [tests-sht1x] PASSED
01. Task 03 - Unittests on native separated [tests-sixlowpan] PASSED
01. Task 03 - Unittests on native separated [tests-sixlowpan_ctx] PASSED
01. Task 03 - Unittests on native separated [tests-sixlowpan_sfr] PASSED
01. Task 03 - Unittests on native separated [tests-sock_util] PASSED
01. Task 03 - Unittests on native separated [tests-timex] PASSED
01. Task 03 - Unittests on native separated [tests-tsrb] PASSED
01. Task 03 - Unittests on native separated [tests-turo] PASSED
01. Task 03 - Unittests on native separated [tests-uri_parser] PASSED
01. Task 03 - Unittests on native separated [tests-ut_process] PASSED
01. Task 03 - Unittests on native separated [tests-uuid] PASSED
01. Task 03 - Unittests on native separated [tests-vfs] PASSED
01. Task 03 - Unittests on native separated [tests-zptr] PASSED
01. Task 03 - Unittests on native separated [tests-ztimer64] PASSED
01. Task 03 - Unittests on native separated [tests-ztimer] PASSED
01. Task 04 - Unittests on iotlab-m3 PASSED
03. Task 01 - ICMPv6 multicast echo on native PASSED
03. Task 02 - ICMPv6 link-local echo on native PASSED
03. Task 03 - ICMPv6 link-local echo on native (1 hour) PASSED
03. Task 04 - ICMPv6 stress test on native (1 hour) PASSED
03. Task 05 - ICMPv6 stress test on native (neighbor cache stress) PASSED
03. Task 06 - ICMPv6 link-local echo on native (IPv6 fragmentation) PASSED
04. Task 02 - ICMPv6 multicast echo with iotlab-m3/samr21-xpro PASSED
04. Task 03 - ICMPv6 echo with large payload PASSED
04. Task 04 - ICMPv6 echo with iotlab-m3/samr21-xpro 15 minutes PASSED
🟡 04. Task 05 (Experimental) - ICMPv6 multicast echo with samr21-xpro/cc2538 [lille] SKIPPED
🟡 04. Task 06 (Experimental)- ICMPv6 link-local echo with samr21-xpro/cc2538 [lille] SKIPPED
🟡 04. Task 07 (Experimental) - ICMPv6 multicast echo with samr21-xpro/zero + xbee SKIPPED
🟡 04. Task 08 (Experimental) - ICMPv6 echo with samr21-xpro/zero + xbee SKIPPED
04. Task 09 - ICMPv6 stress test on iotlab-m3 PASSED
04. Task 10 (Experimental) - ICMPv6 echo with large payload (IPv6 fragmentation) PASSED
04. Task 11 (Experimental) - ICMPv6 stress test on nrf802154 PASSED
04. Task 12 (Experimental) - ICMPv6 multicast echo with iotlab-m3/nrf802154 PASSED
04. Task 13 (Experimental) - ICMPv6 link-local echo with iotlab-m3/nrf802154 PASSED
05. Task 01 - ICMPv6 echo unicast addresess on native (default route) PASSED
05. Task 02 - ICMPv6 echo unicast addresess on iotlab-m3 (default route) PASSED
05. Task 03 - ICMPv6 echo unicast addresess on native (specific route) PASSED
05. Task 04 - ICMPv6 echo unicast addresess on iotlab-m3 (static route) PASSED
06. Task 01 - UDP on iotlab-m3 PASSED
06. Task 02 - UDP on iotlab-m3 (UDP port compression) PASSED
06. Task 03 - UDP on native (non-existent neighbor) PASSED
06. Task 04 - UDP on iotlab-m3 (non-existent neighbor) PASSED
06. Task 05 - Empty UDP on native PASSED
06. Task 06 - Empty UDP on iotlab-m3 PASSED
07. Task 01 - ICMPv6 echo on iotlab-m3 with three hops (static route) PASSED
07. Task 02 - UDP on iotlab-m3 with three hops (static route) PASSED
07. Task 03 - ICMPv6 echo on iotlab-m3 with three hops (RPL route) PASSED
07. Task 04 - UDP on iotlab-m3 with three hops (RPL route) PASSED
08. Task 01 - ICMPv6 echo between native and Linux PASSED
08. Task 08 - UDP between GNRC and lwIP on iotlab-m3 PASSED
09. Task 01 - CORD Endpoint PASSED
09. Task 02 - Confirmable retries [False-0] PASSED
09. Task 02 - Confirmable retries [True-1] PASSED
09. Task 03 - Block1 PASSED
09. Task 04 - Block2 PASSED
09. Task 05 - Observe registration and notification PASSED
10. Task 01 - Destination unreachable - no route to destination PASSED
10. Task 02 - Destination unreachable - Beyond scope of source address PASSED
10. Task 03 - Destination unreachable - address unreachable (target node address) PASSED
10. Task 04 - Destination unreachable - address unreachable (neighbor cache miss) PASSED
10. Task 05 - Destination unreachable - port unreachable PASSED
10. Task 06 - Destination unreachable - port unreachable (large payload) PASSED
10. Task 07 - Packet too big PASSED
10. Task 08 - Time exceeded - hop limit exceeded in transit PASSED
10. Task 09 - Parameter problem - erroneous header field encountered PASSED
10. Task 10 - IPv6-in-IPv6 encapsulation PASSED
11. Task 01 - LoRaWAN example PASSED
11. Task 02 - OTAA join procedure PASSED
11. Task 03 - ABP join procedure PASSED
11. Task 04 - LoRaWAN device parameters persistence PASSED
11. Task 05 - GNRC LoRaWAN (Over The Air Activation) [otaa] PASSED
🟡 11. Task 06 - GNRC LoRaWAN (ABP) [abp] SKIPPED
leandrolanzieri commented 1 year ago

Regarding the remaining Linux interop tests, I think @jia200x was going to give them a try

maribu commented 1 year ago

compile_and_test_for_board.py

nrf52840dk

Failures during test:

nucleo-f767zi

Failures during test:

Failures during test.flash:

samr21-xpro

Failures during test:

native

Failures during compilation:

Failures during test:

arduino-mega2560

Failures during compilation:

Failures during test:

qn9080dk

Failures during test:

kaspar030 commented 1 year ago

these two are build environment errors - which system was this built on?

maribu commented 1 year ago

these two are build environment errors - which system was this built on?

I manually launched riot/riotbuild. It should basically yield the same result as in Murdock.

maribu commented 1 year ago

08-Interop

Task 12

2022-12-01 01:06:55,856 # ets Jun  8 2016 00:22:57
2022-12-01 01:06:55,856 # 
2022-12-01 01:06:55,857 # rst:0x1 (POWERON_RESET),boot:0x13 (SPI_FAST_FLASH_BOOT)
2022-12-01 01:06:55,858 # configsip: 0, SPIWP:0xee
2022-12-01 01:06:55,859 # clk_drv:0x00,q_drv:0x00,d_drv:0x00,cs0_drv:0x00,hd_drv:0x00,wp_drv:0x00
2022-12-01 01:06:55,860 # mode:DOUT, clock div:2
2022-12-01 01:06:55,861 # load:0x3fff0030,len:1472
2022-12-01 01:06:55,861 # load:0x40078000,len:12788
2022-12-01 01:06:55,862 # ho 0 tail 12 room 4
2022-12-01 01:06:55,862 # load:0x40080400,len:2848
2022-12-01 01:06:55,863 # entry 0x40080410
2022-12-01 01:06:56,054 # Pro cpu up.
2022-12-01 01:06:56,055 # Single core mode
2022-12-01 01:06:56,132 # Initializing. RAM available for dynamic allocation:
2022-12-01 01:06:56,133 # At 3FFAE6E0 len 00001920 (6 KiB): DRAM
2022-12-01 01:06:56,134 # At 3FFBDCE0 len 00022320 (136 KiB): DRAM
2022-12-01 01:06:56,135 # At 3FFE0440 len 0001FBC0 (126 KiB): D/IRAM
2022-12-01 01:06:56,136 # At 40078000 len 00008000 (32 KiB): IRAM
2022-12-01 01:06:56,136 # At 4008F930 len 000106D0 (65 KiB): IRAM
2022-12-01 01:06:56,137 # 
2022-12-01 01:06:58,043 # DHCPv6: Selecting interface 10 as upstream
2022-12-01 01:06:58,044 # DHCPv6: Selecting interface 10 as upstream
2022-12-01 01:06:58,045 # main(): This is RIOT! (Version: 2023.01-devel-84-ge2513-2022.10-branch)
2022-12-01 01:06:58,046 # RIOT border router example application
2022-12-01 01:06:58,047 # All up, running the shell now
> 2022-12-01 01:07:02,218 # WiFi connected to ssid Loeffelnetz, channel 11
ifconfig
2022-12-01 01:07:03,516 # ifconfig
2022-12-01 01:07:03,517 # Iface  9  HWaddr: A4:CF:12:44:E8:15  Channel: 11 
2022-12-01 01:07:03,518 #           L2-PDU:249  MTU:1280  HL:64  RTR  
2022-12-01 01:07:03,519 #           6LO  Source address length: 6
2022-12-01 01:07:03,520 #           Link type: wireless
2022-12-01 01:07:03,521 #           inet6 addr: fe80::a6cf:12ff:fe44:e815  scope: link  VAL
2022-12-01 01:07:03,537 #           inet6 group: ff02::2
2022-12-01 01:07:03,538 #           inet6 group: ff02::1
2022-12-01 01:07:03,539 #           inet6 group: ff02::1:ff44:e815
2022-12-01 01:07:03,539 #           
2022-12-01 01:07:03,540 # Iface  10  HWaddr: A4:CF:12:44:E8:14  Channel: 11  Link: up 
2022-12-01 01:07:03,541 #           L2-PDU:1500  MTU:1492  HL:255  RTR  
2022-12-01 01:07:03,542 #           Source address length: 6
2022-12-01 01:07:03,560 #           Link type: wireless
2022-12-01 01:07:03,561 #           inet6 addr: fe80::a6cf:12ff:fe44:e814  scope: link  VAL
2022-12-01 01:07:03,562 #           inet6 addr: 2a01:c22:adcf:7300:a6cf:12ff:fe44:e814  scope: global  TNT[1]
2022-12-01 01:07:03,563 #           inet6 group: ff02::2
2022-12-01 01:07:03,563 #           inet6 group: ff02::1
2022-12-01 01:07:03,564 #           inet6 group: ff02::1:ff44:e814
2022-12-01 01:07:03,565 #           
> ping 2001:4d88:3508::fefe:b106
2022-12-01 01:07:14,558 # ping 2001:4d88:3508::fefe:b106
2022-12-01 01:07:14,607 # 12 bytes from 2001:4d88:3508::fefe:b106: icmp_seq=0 ttl=55 time=43.163 ms
2022-12-01 01:07:15,603 # 12 bytes from 2001:4d88:3508::fefe:b106: icmp_seq=1 ttl=55 time=39.769 ms
2022-12-01 01:07:16,617 # 12 bytes from 2001:4d88:3508::fefe:b106: icmp_seq=2 ttl=55 time=39.777 ms
2022-12-01 01:07:16,617 # 
2022-12-01 01:07:16,618 # --- 2001:4d88:3508::fefe:b106 PING statistics ---
2022-12-01 01:07:16,619 # 3 packets transmitted, 3 packets received, 0% packet loss
2022-12-01 01:07:16,620 # round-trip min/avg/max = 39.769/40.903/43.163 ms
> ping riot-os.org
2022-12-01 01:07:19,816 # ping riot-os.org
2022-12-01 01:07:19,981 # 12 bytes from 2001:67c:254:b0b0::1: icmp_seq=0 ttl=58 time=154.417 ms
2022-12-01 01:07:20,882 # 12 bytes from 2001:67c:254:b0b0::1: icmp_seq=1 ttl=58 time=55.507 ms
2022-12-01 01:07:22,037 # 12 bytes from 2001:67c:254:b0b0::1: icmp_seq=2 ttl=58 time=197.862 ms
2022-12-01 01:07:22,037 # 
2022-12-01 01:07:22,038 # --- riot-os.org PING statistics ---
2022-12-01 01:07:22,039 # 3 packets transmitted, 3 packets received, 0% packet loss
2022-12-01 01:07:22,040 # round-trip min/avg/max = 55.507/135.928/197.862 ms

==> SUCCESS

Task 13

2022-12-01 01:06:45,570 # ets Jun  8 2016 00:22:57
2022-12-01 01:06:45,570 # 
2022-12-01 01:06:45,572 # rst:0x1 (POWERON_RESET),boot:0x13 (SPI_FAST_FLASH_BOOT)
2022-12-01 01:06:45,572 # configsip: 0, SPIWP:0xee
2022-12-01 01:06:45,573 # clk_drv:0x00,q_drv:0x00,d_drv:0x00,cs0_drv:0x00,hd_drv:0x00,wp_drv:0x00
2022-12-01 01:06:45,574 # mode:DOUT, clock div:2
2022-12-01 01:06:45,574 # load:0x3fff0030,len:1472
2022-12-01 01:06:45,575 # load:0x40078000,len:12788
2022-12-01 01:06:45,575 # ho 0 tail 12 room 4
2022-12-01 01:06:45,576 # load:0x40080400,len:2848
2022-12-01 01:06:45,576 # entry 0x40080410
2022-12-01 01:06:45,771 # Pro cpu up.
2022-12-01 01:06:45,771 # Single core mode
2022-12-01 01:06:45,848 # Initializing. RAM available for dynamic allocation:
2022-12-01 01:06:45,849 # At 3FFAE6E0 len 00001920 (6 KiB): DRAM
2022-12-01 01:06:45,850 # At 3FFBC668 len 00023998 (142 KiB): DRAM
2022-12-01 01:06:45,851 # At 3FFE0440 len 0001FBC0 (126 KiB): D/IRAM
2022-12-01 01:06:45,852 # At 40078000 len 00008000 (32 KiB): IRAM
2022-12-01 01:06:45,852 # At 4008F78C len 00010874 (66 KiB): IRAM
2022-12-01 01:06:45,852 # 
2022-12-01 01:06:47,755 # NETOPT_TX_END_IRQ not implemented by driver
2022-12-01 01:06:47,756 # main(): This is RIOT! (Version: 2023.01-devel-84-ge2513-2022.10-branch)
2022-12-01 01:06:47,757 # RIOT network stack example application
2022-12-01 01:06:47,757 # All up, running the shell now
> ifconfig
2022-12-01 01:08:11,567 # ifconfig
2022-12-01 01:08:11,568 # Iface  10  HWaddr: A4:CF:12:44:D4:81  Channel: 6 
2022-12-01 01:08:11,569 #           L2-PDU:249  MTU:1280  HL:64  RTR  
2022-12-01 01:08:11,569 #           6LO  Source address length: 6
2022-12-01 01:08:11,570 #           Link type: wireless
2022-12-01 01:08:11,572 #           inet6 addr: fe80::a6cf:12ff:fe44:d481  scope: link  VAL
2022-12-01 01:08:11,589 #           inet6 group: ff02::2
2022-12-01 01:08:11,590 #           inet6 group: ff02::1
2022-12-01 01:08:11,591 #           inet6 group: ff02::1:ff44:d481
2022-12-01 01:08:11,591 #           inet6 group: ff02::1a
2022-12-01 01:08:11,592 #           
2022-12-01 01:08:11,592 #           Statistics for Layer 2
2022-12-01 01:08:11,593 #             RX packets 0  bytes 0
2022-12-01 01:08:11,593 #             TX packets 0 (Multicast: 0)  bytes 0
2022-12-01 01:08:11,605 #             TX succeeded 0 errors 0
2022-12-01 01:08:11,605 #           Statistics for IPv6
2022-12-01 01:08:11,606 #             RX packets 0  bytes 0
2022-12-01 01:08:11,606 #             TX packets 8 (Multicast: 8)  bytes 442
2022-12-01 01:08:11,607 #             TX succeeded 8 errors 0
2022-12-01 01:08:11,607 # 
> ifconfig 10 set channel 11
2022-12-01 01:08:16,594 # ifconfig 10 set channel 11
2022-12-01 01:08:16,605 # success: set channel on interface 10 to 11
> ping fe80::a6cf:12ff:fe44:e815
2022-12-01 01:08:24,597 # ping fe80::a6cf:12ff:fe44:e815
2022-12-01 01:08:24,613 # 12 bytes from fe80::a6cf:12ff:fe44:e815%10: icmp_seq=0 ttl=64 time=7.434 ms
2022-12-01 01:08:25,612 # 12 bytes from fe80::a6cf:12ff:fe44:e815%10: icmp_seq=1 ttl=64 time=6.597 ms
2022-12-01 01:08:26,625 # 12 bytes from fe80::a6cf:12ff:fe44:e815%10: icmp_seq=2 ttl=64 time=6.112 ms
2022-12-01 01:08:26,625 # 
2022-12-01 01:08:26,626 # --- fe80::a6cf:12ff:fe44:e815 PING statistics ---
2022-12-01 01:08:26,627 # 3 packets transmitted, 3 packets received, 0% packet loss
2022-12-01 01:08:26,627 # round-trip min/avg/max = 6.112/6.714/7.434 ms
> ifconfig
2022-12-01 01:08:28,234 # ifconfig
2022-12-01 01:08:28,235 # Iface  10  HWaddr: A4:CF:12:44:D4:81  Channel: 11 
2022-12-01 01:08:28,236 #           L2-PDU:249  MTU:1280  HL:64  RTR  
2022-12-01 01:08:28,237 #           6LO  Source address length: 6
2022-12-01 01:08:28,237 #           Link type: wireless
2022-12-01 01:08:28,238 #           inet6 addr: fe80::a6cf:12ff:fe44:d481  scope: link  VAL
2022-12-01 01:08:28,257 #           inet6 group: ff02::2
2022-12-01 01:08:28,258 #           inet6 group: ff02::1
2022-12-01 01:08:28,259 #           inet6 group: ff02::1:ff44:d481
2022-12-01 01:08:28,259 #           inet6 group: ff02::1a
2022-12-01 01:08:28,259 #           
2022-12-01 01:08:28,260 #           Statistics for Layer 2
2022-12-01 01:08:28,260 #             RX packets 0  bytes 0
2022-12-01 01:08:28,261 #             TX packets 0 (Multicast: 0)  bytes 162
2022-12-01 01:08:28,272 #             TX succeeded 3 errors 0
2022-12-01 01:08:28,273 #           Statistics for IPv6
2022-12-01 01:08:28,273 #             RX packets 4  bytes 212
2022-12-01 01:08:28,274 #             TX packets 11 (Multicast: 8)  bytes 598
2022-12-01 01:08:28,275 #             TX succeeded 11 errors 0
2022-12-01 01:08:28,275 # 
> ifconfig
2022-12-01 01:09:29,596 # ifconfig
2022-12-01 01:09:29,598 # Iface  10  HWaddr: A4:CF:12:44:D4:81  Channel: 11 
2022-12-01 01:09:29,599 #           L2-PDU:249  MTU:1280  HL:64  RTR  
2022-12-01 01:09:29,599 #           6LO  Source address length: 6
2022-12-01 01:09:29,600 #           Link type: wireless
2022-12-01 01:09:29,601 #           inet6 addr: fe80::a6cf:12ff:fe44:d481  scope: link  VAL
2022-12-01 01:09:29,618 #           inet6 group: ff02::2
2022-12-01 01:09:29,619 #           inet6 group: ff02::1
2022-12-01 01:09:29,620 #           inet6 group: ff02::1:ff44:d481
2022-12-01 01:09:29,620 #           inet6 group: ff02::1a
2022-12-01 01:09:29,621 #           
2022-12-01 01:09:29,621 #           Statistics for Layer 2
2022-12-01 01:09:29,622 #             RX packets 0  bytes 0
2022-12-01 01:09:29,622 #             TX packets 0 (Multicast: 0)  bytes 220
2022-12-01 01:09:29,635 #             TX succeeded 4 errors 0
2022-12-01 01:09:29,635 #           Statistics for IPv6
2022-12-01 01:09:29,636 #             RX packets 5  bytes 268
2022-12-01 01:09:29,637 #             TX packets 12 (Multicast: 9)  bytes 654
2022-12-01 01:09:29,638 #             TX succeeded 12 errors 0
2022-12-01 01:09:29,638 # 

==> FAILED (no public IPv6 address obtained)

maribu commented 1 year ago

@benpicco, @gschorcht: Any idea why 8.13 failed?

Is the issue that my WiFi is using channel 11 and the test only succeeds when channel 6 is used?

gschorcht commented 1 year ago

@benpicco, @gschorcht: Any idea why 8.13 failed?

Is the issue that my WiFi is using channel 11 and the test only succeeds when channel 6 is used?

@maribu Unfortunatly, I can't test it because my shitty Telekom Speedport Pro Plus Router doesn't support prefix delegation :worried:

What I can say is that if your WiFi is using channel 11, you have to configure the same channel for the ESP-NOW interface by ESP_NOW_CHANNEL. Try to add CFLAGS='-DESP_NOW_CHANNEL=11' to your make command line for the border router and the ESP_NOW node.

For the background, ESP-NOW and ESP-WiFi are using the single WiFi interface in Station and Soft-AP mode at the same time so that the channel for the Soft-AP mode used by ESP-NOW has to be the same as for the Station mode used by ESP-WiFi and ESP-NOW.

maribu commented 1 year ago

I was told that @MrKevinWeiss ran the Contiki interop test and marked it as passed. Please holler if this is incorrect.

leandrolanzieri commented 1 year ago

I was told that @MrKevinWeiss ran the Contiki interop test and marked it as passed. Please holler if this is incorrect.

I added the reference to the comment https://github.com/RIOT-OS/Release-Specs/issues/264#issuecomment-1302117849

leandrolanzieri commented 1 year ago

For the following tests I could not manage to reach addresses past the iotlab A8 node. There may be a missconfiguration. The RIOT node reaches the Linux host running on the A8 via the BR (running on the m3 node of the A8 board). We discussed this offline with @maribu, for now we will consider these passes, but he may re-run them on a different hardware later.

08. Interop - Task 05 [PASSED]
  • Pinging the Linux host on the A8 node.
``` > ping -c 50 2001:660:3207:400::64 12 bytes from 2001:660:3207:400::64: icmp_seq=0 ttl=63 rssi=-64 dBm time=18.901 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=1 ttl=63 rssi=-64 dBm time=26.593 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=2 ttl=63 rssi=-64 dBm time=18.727 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=3 ttl=63 rssi=-64 dBm time=26.988 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=4 ttl=63 rssi=-64 dBm time=19.902 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=7 ttl=63 rssi=-64 dBm time=25.003 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=8 ttl=63 rssi=-64 dBm time=17.140 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=9 ttl=63 rssi=-64 dBm time=25.445 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=11 ttl=63 rssi=-64 dBm time=26.148 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=12 ttl=63 rssi=-64 dBm time=17.127 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=13 ttl=63 rssi=-64 dBm time=25.638 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=14 ttl=63 rssi=-64 dBm time=16.485 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=15 ttl=63 rssi=-64 dBm time=24.813 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=16 ttl=63 rssi=-64 dBm time=17.677 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=17 ttl=63 rssi=-64 dBm time=24.516 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=18 ttl=63 rssi=-64 dBm time=17.455 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=19 ttl=63 rssi=-64 dBm time=25.687 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=20 ttl=63 rssi=-64 dBm time=16.906 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=21 ttl=63 rssi=-64 dBm time=23.899 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=22 ttl=63 rssi=-64 dBm time=16.366 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=23 ttl=63 rssi=-64 dBm time=25.213 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=24 ttl=63 rssi=-64 dBm time=16.404 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=25 ttl=63 rssi=-64 dBm time=23.206 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=26 ttl=63 rssi=-64 dBm time=15.014 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=27 ttl=63 rssi=-64 dBm time=23.136 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=28 ttl=63 rssi=-64 dBm time=15.728 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=29 ttl=63 rssi=-64 dBm time=25.161 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=30 ttl=63 rssi=-64 dBm time=16.698 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=31 ttl=63 rssi=-64 dBm time=24.919 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=32 ttl=63 rssi=-64 dBm time=16.557 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=33 ttl=63 rssi=-64 dBm time=24.110 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=34 ttl=63 rssi=-64 dBm time=15.530 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=35 ttl=63 rssi=-64 dBm time=22.381 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=36 ttl=63 rssi=-64 dBm time=14.800 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=37 ttl=63 rssi=-64 dBm time=53.115 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=39 ttl=63 rssi=-64 dBm time=22.324 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=40 ttl=63 rssi=-64 dBm time=29.857 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=41 ttl=63 rssi=-64 dBm time=21.221 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=43 ttl=63 rssi=-64 dBm time=20.678 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=44 ttl=63 rssi=-64 dBm time=29.411 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=45 ttl=63 rssi=-64 dBm time=20.724 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=46 ttl=63 rssi=-64 dBm time=27.229 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=47 ttl=63 rssi=-64 dBm time=19.235 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=48 ttl=63 rssi=-64 dBm time=27.408 ms 12 bytes from 2001:660:3207:400::64: icmp_seq=49 ttl=63 rssi=-64 dBm time=19.976 ms --- 2001:660:3207:400::64 PING statistics --- 50 packets transmitted, 45 packets received, 10% packet loss round-trip min/avg/max = 14.800/22.254/53.115 ms ```

08. Interop - Task 06 [PASSED]
  • Sending 8 bytes to the UDP echo server on the A8 node.
``` udp send 2001:660:3207:400::64 1234 "riot1234" Success: sent 8 byte(s) to [2001:660:3207:400::64]:1234 > > PKTDUMP: data received: ~~ SNIP 0 - size: 8 byte, type: NETTYPE_UNDEF (0) 00000000 72 69 6F 74 31 32 33 34 ~~ SNIP 1 - size: 8 byte, type: NETTYPE_UDP (4) src-port: 1234 dst-port: 1234 length: 16 cksum: 0x966c ~~ SNIP 2 - size: 40 byte, type: NETTYPE_IPV6 (2) traffic class: 0x00 (ECN: 0x0, DSCP: 0x00) flow label: 0xbf92e length: 16 next header: 17 hop limit: 63 source address: 2001:660:3207:400::64 destination address: 2001:660:3207:464:6462:640c:2c76:6afc ~~ SNIP 3 - size: 24 byte, type: NETTYPE_NETIF (-1) if_pid: 6 rssi: -64 lqi: 255 flags: 0x0 src_l2addr: 5E:A3:8E:A2:3A:63:56:77 dst_l2addr: 66:62:64:0C:2C:76:6A:FC ~~ PKT - 4 snips, total size: 80 byte ```

08. Interop - Task 07 [PASSED]
  • Sending 200 bytes to the UDP echo server on the A8 node.
  • No pktbuf overflow.
``` main(): This is RIOT! (Version: 2023.01-devel-84-ge2513-HEAD) > udp server start 1234 Success: started UDP server on port 1234 > > udp send 2001:660:3207:400::64 1234 200 10 Success: send 200 byte to [2001:660:3207:400::64]:1234 Packets received: 1 Success: send 200 byte to [2001:660:3207:400::64]:1234 Packets received: 2 Success: send 200 byte to [2001:660:3207:400::64]:1234 Packets received: 3 Success: send 200 byte to [2001:660:3207:400::64]:1234 Packets received: 4 Success: send 200 byte to [2001:660:3207:400::64]:1234 Packets received: 5 Success: send 200 byte to [2001:660:3207:400::64]:1234 Packets received: 6 Success: send 200 byte to [2001:660:3207:400::64]:1234 Packets received: 7 Success: send 200 byte to [2001:660:3207:400::64]:1234 Packets received: 8 Success: send 200 byte to [2001:660:3207:400::64]:1234 Packets received: 9 Success: send 200 byte to [2001:660:3207:400::64]:1234 Packets received: 10 > ```
leandrolanzieri commented 1 year ago

tcpdump shows packets arriving to the A8 node, and they show up in its eth0 interface... :/

root@node-a8-100:~# tcpdump -i eth0 icmp6     
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on eth0, link-type EN10MB (Ethernet), capture size 262144 bytes
19:23:52.748005 IP6 2001:660:3207:464:6462:640c:2c76:6afc > 2001:660:3207:4bf::17: ICMP6, echo request, seq 0, length 12
19:23:53.755800 IP6 2001:660:3207:464:6462:640c:2c76:6afc > 2001:660:3207:4bf::17: ICMP6, echo request, seq 1, length 12
19:23:54.747732 IP6 2001:660:3207:464:6462:640c:2c76:6afc > 2001:660:3207:4bf::17: ICMP6, echo request, seq 2, length 12
maribu commented 1 year ago

I finally got the ESP border router working

gschorcht commented 1 year ago

I finally got the ESP border router working

Was it the ESP-NOW channel or something else?

maribu commented 1 year ago

Both. I have two routers (one that I chose with OpenWrt, one that I didn't chose with a proprietary firmware that I need to connect to the ISP). I was struggling hard to get prefix delegation working from the first router to the second to the boarder router. I still ended up with the boarder router choosing the ULA over the public prefix and assumed it to be an issue with my router setup, but it is rather a bug in RIOT. Disabling ULA in the OpenWRT box workes around the issue.

If the second ESP switched the channel at runtime to the one ESP border router chose (it picked the acccess point with the best signal and used the same channel for ESP NOW), I had no connectivity between the two ESPs.

I think it did work once to switch the channel at run time. But I am not sure anymore.

kaspar030 commented 1 year ago

It could compile those two on 2022.10-branch both on current arch and with BUILD_IN_DOCKER=1.

jia200x commented 1 year ago

I will run the missing interop tests during the day