search

RIOT-OS / Release-Specs

Specification for RIOT releases and corresponding test configurations
4 stars 21 forks source link

Release 2020.01 - RC1 #145

Closed fjmolinas closed 4 years ago

fjmolinas commented 4 years ago

This issue lists the status of all tests for the Release Candidate 1 of the 2020.01 release.

Specs tested:

fjmolinas commented 4 years ago

@RIOT-OS/maintainers people in Berlin, do you know if @cladmi paper-ci is still plugged in? I would like to run the tests on his boards as well. I should have unicasted this, sorry for the spam.

miri64 commented 4 years ago

It is still plugged in. No guarantee if it still works though.

MichelRottleuthner commented 4 years ago

@JulianHolzwarth should be able to provide some info as he AFAIK sits right next to it and used it before

fjmolinas commented 4 years ago

Seems to be working, just launched a build

miri64 commented 4 years ago

@SemjonKerner also sits right next to it for the next few weeks ;-).

fjmolinas commented 4 years ago

I'm currently adapting the scripts in https://github.com/RIOT-OS/Release-Specs/pull/79 to use pytest and more importantly riotnode abstraction https://github.com/RIOT-OS/RIOT/pull/10949. My working branch is https://github.com/fjmolinas/Release-Specs/tree/pr/utils. I'll as a PR when I finish reworking all scripts. But the results of some of the tests I run will use this. riotnode is used as an external python library so I'm building on a clean release branch.

MrKevinWeiss commented 4 years ago
07-multi-hop Task 01 - ICMPv6 echo on iotlab-m3 with three hops (static route) PASS ``` 58 bytes from abcd::2: icmp_seq=96 ttl=62 rssi=-43 dBm time=44.513 ms 58 bytes from abcd::2: icmp_seq=97 ttl=62 rssi=-43 dBm time=45.473 ms 58 bytes from abcd::2: icmp_seq=98 ttl=62 rssi=-43 dBm time=43.561 ms 58 bytes from abcd::2: icmp_seq=99 ttl=62 rssi=-43 dBm time=41.954 ms --- abcd::2 PING statistics --- 100 packets transmitted, 100 packets received, 0% packet loss round-trip min/avg/max = 36.853/41.554/45.473 ms
MrKevinWeiss commented 4 years ago
07-multi-hop Task 02 - UDP on iotlab-m3 with three hops (static route) PASS ``` Packets received: 97 Packets received: 98 Packets received: 99 Packets received: 100
fjmolinas commented 4 years ago
04-single-hop-6lowpan-icmp Task 1 Passes ``` 04-single-hop-6lowpan-icmp/test.py fe80::54ad:fc65:106b:1115: icmp_seq=999 ttl=64 rssi=-46 dBm --- fe80::54ad:fc65:106b:1115 PING statistics --- 1000 packets transmitted, 1000 packets received, 0% packet loss packet buffer: first byte: 0x200019a8, last byte: 0x200031a8 (size: 6144) ~ unused: 0x200019a8 (next: (nil), size: 6144) ~ packet buffer: first byte: 0x200019a8, last byte: 0x200031a8 (size: 6144) ~ unused: 0x200019a8 (next: (nil), size: 6144) ~ fe80::50bd:fc65:106b:1115: icmp_seq=999 ttl=64 rssi=-46 dBm --- fe80::50bd:fc65:106b:1115 PING statistics --- 1000 packets transmitted, 1000 packets received, 0% packet loss packet buffer: first byte: 0x200019a8, last byte: 0x200031a8 (size: 6144) ~ unused: 0x200019a8 (next: (nil), size: 6144) ~ packet buffer: first byte: 0x200019a8, last byte: 0x200031a8 (size: 6144) ~ unused: 0x200019a8 (next: (nil), size: 6144) ~ . ```
04-single-hop-6lowpan-icmp Task 2 Passes ``` fe80::50bd:fc65:106b:1115: icmp_seq=999 ttl=64 rssi=-63 dBm time=12.244 ms --- ff02::1 PING statistics --- 1000 packets transmitted, 970 packets received, 37 duplicates, 3% packet loss packet buffer: first byte: 0x200019a0, last byte: 0x200031a0 (size: 6144) ~ unused: 0x200019a0 (next: (nil), size: 6144) ~ packet buffer: first byte: 0x200019a8, last byte: 0x200031a8 (size: 6144) ~ unused: 0x200019a8 (next: (nil), size: 6144) ~ fe80::e43d:a00e:6433:6279: icmp_seq=999 ttl=64 rssi=-60 dBm time=9.881 ms --- ff02::1 PING statistics --- 1000 packets transmitted, 998 packets received, 2 duplicates, 0% packet loss packet buffer: first byte: 0x200019a8, last byte: 0x200031a8 (size: 6144) ~ unused: 0x200019a8 (next: (nil), size: 6144) ~ packet buffer: first byte: 0x200019a0, last byte: 0x200031a0 (size: 6144) ~ unused: 0x200019a0 (next: (nil), size: 6144) ~ . ============================== 1 passed, 9 deselected in 286.91s (0:04:46) =============================== ```
04-single-hop-6lowpan-icmp Task 3 Passes ``` fe80::54ad:fc65:106b:1115: icmp_seq=499 ttl=64 rssi=-46 dBm time=135.167 ms --- fe80::54ad:fc65:106b:1115 PING statistics --- 500 packets transmitted, 500 packets received, 0% packet loss round-trip min/avg/max = 124.362/137.755/151.156 ms > pktbuf packet buffer: first byte: 0x200019a8, last byte: 0x200031a8 (size: 6144) position of last byte used: 1440 ~ unused: 0x200019a8 (next: (nil), size: 6144) ~ > pktbuf packet buffer: first byte: 0x200019a8, last byte: 0x200031a8 (size: 6144) position of last byte used: 2344 ~ unused: 0x200019a8 (next: (nil), size: 6144) ~ fe80::50bd:fc65:106b:1115: icmp_seq=499 ttl=64 rssi=-46 dBm time=133.578 ms --- fe80::50bd:fc65:106b:1115 PING statistics --- 500 packets transmitted, 499 packets received, 0% packet loss round-trip min/avg/max = 124.641/137.760/152.404 ms > pktbuf packet buffer: first byte: 0x200019a8, last byte: 0x200031a8 (size: 6144) position of last byte used: 1440 ~ unused: 0x200019a8 (next: (nil), size: 6144) ~ > pktbuf packet buffer: first byte: 0x200019a8, last byte: 0x200031a8 (size: 6144) position of last byte used: 3488 ~ unused: 0x200019a8 (next: (nil), size: 6144) ~ . ================================== 1 passed, 9 deselected in 373.45s (0:06:13) =================================== ```
04-single-hop-6lowpan-icmp Task 4 Passes ``` fe80::54ad:fc65:106b:1115: icmp_seq=9999 ttl=64 rssi=-66 dBm time=22.433 ms --- fe80::54ad:fc65:106b:1115 PING statistics --- 10000 packets transmitted, 9996 packets received, 0% packet loss packet buffer: first byte: 0x200019a0, last byte: 0x200031a0 (size: 6144) ~ unused: 0x200019a0 (next: (nil), size: 6144) ~ packet buffer: first byte: 0x200019a8, last byte: 0x200031a8 (size: 6144) ~ unused: 0x200019a8 (next: (nil), size: 6144) ~ fe80::986f:e2f7:2f09:6479: icmp_seq=9999 ttl=64 rssi=-62 dBm time=20.563 ms --- fe80::986f:e2f7:2f09:6479 PING statistics --- 10000 packets transmitted, 9997 packets received, 0% packet loss packet buffer: first byte: 0x200019a8, last byte: 0x200031a8 (size: 6144) ~ unused: 0x200019a8 (next: (nil), size: 6144) ~ packet buffer: first byte: 0x200019a0, last byte: 0x200031a0 (size: 6144) ~ unused: 0x200019a0 (next: (nil), size: 6144) ~ . ============================== 1 passed, 9 deselected in 2080.86s (0:34:40) ============================== ```
04-single-hop-6lowpan-icmp Task 9 Passes ``` ping6 fe80::54ad:fc65:106b:1115 -s 1232 -i 0 -c 200 --- fe80::54ad:fc65:106b:1115 PING statistics --- 200 packets transmitted, 0 packets received, 100% packet loss packet buffer: first byte: 0x200019a8, last byte: 0x200031a8 (size: 6144) ~ unused: 0x200019a8 (next: (nil), size: 6144) ~ packet buffer: first byte: 0x200019a8, last byte: 0x200031a8 (size: 6144) ~ unused: 0x200019a8 (next: (nil), size: 6144) ~ . fe80::50bd:fc65:106b:1115: icmp_seq=199 ttl=64 rssi=-45 dBm time=170.461 ms --- fe80::50bd:fc65:106b:1115 PING statistics --- 200 packets transmitted, 1 packets received, 99% packet loss packet buffer: first byte: 0x200019a8, last byte: 0x200031a8 (size: 6144) ~ unused: 0x200019a8 (next: (nil), size: 6144) ~ packet buffer: first byte: 0x200019a8, last byte: 0x200031a8 (size: 6144) ~ unused: 0x200019a8 (next: (nil), size: 6144) ~ . ============================== 1 passed, 9 deselected in 120.14s (0:02:00) =============================== ```
MrKevinWeiss commented 4 years ago
07-multi-hop Task 03 - ICMPv6 echo on iotlab-m3 with three hops (RPL route) PASS ``` 58 bytes from abcd::1: icmp_seq=96 ttl=62 rssi=-39 dBm time=42.345 ms 58 bytes from abcd::1: icmp_seq=97 ttl=62 rssi=-39 dBm time=41.726 ms 58 bytes from abcd::1: icmp_seq=98 ttl=62 rssi=-39 dBm time=40.754 ms 58 bytes from abcd::1: icmp_seq=99 ttl=62 rssi=-39 dBm time=41.392 ms --- abcd::1 PING statistics --- 100 packets transmitted, 100 packets received, 0% packet loss round-trip min/avg/max = 36.925/41.702/47.096 ms
MrKevinWeiss commented 4 years ago
07-multi-hop Task 04 - UDP on iotlab-m3 with three hops (RPL route)PASS ``` Packets received: 61 │make: Leaving directory '/home/kevinweiss/WorkingDirectory/RIOT/tests/gnrc_udp' Packets received: 62 │kevinweiss@kevinweisswork:~/WorkingDirectory/RIOT$ USEMODULE=gnrc_pktbuf_cmd make -C tests/gnrc_udp/ flash-only term Packets received: 63 │make: Entering directory '/home/kevinweiss/WorkingDirectory/RIOT/tests/gnrc_udp' Packets received: 64 │iotlab-node --jmespath='keys(@)[0]' --format='int' --list grenoble,m3,305 --update /home/kevinweiss/WorkingDirectory/RIOT/tests/gnrc_udp Packets received: 65 │/bin/iotlab-m3/tests_gnrc_udp.elf | grep 0 Packets received: 66 │0 Packets received: 67 │ssh -t weoss@grenoble.iot-lab.info 'socat - tcp:m3-305.grenoble.iot-lab.info:20000' Packets received: 68 │ifconfig Packets received: 69 │ifconfig Packets received: 70 │Iface 6 HWaddr: 11:15 Channel: 26 Page: 0 NID: 0x23 Packets received: 71 │ Long HWaddr: 1A:AD:F6:65:10:6B:11:15 Packets received: 72 │ TX-Power: 0dBm State: IDLE max. Retrans.: 3 CSMA Retries: 4 Packets received: 73 │ AUTOACK ACK_REQ CSMA L2-PDU:102 MTU:1280 HL:64 RTR Packets received: 74 │ 6LO IPHC Packets received: 75 │ Source address length: 8 Packets received: 76 │ Link type: wireless Packets received: 77 │ inet6 addr: fe80::18ad:f665:106b:1115 scope: link VAL Packets received: 78 │ inet6 group: ff02::2 Packets received: 79 │ inet6 group: ff02::1 Packets received: 80 │ inet6 group: ff02::1:ff6b:1115 Packets received: 81 │ inet6 group: ff02::1a Packets received: 82 │ Packets received: 83 │ White-listed link layer addresses: Packets received: 84 │ --- none --- Packets received: 85 │ Packets received: 86 │ Statistics for Layer 2 Packets received: 87 │ RX packets 3 bytes 115 Packets received: 88 │ TX packets 3 (Multicast: 3) bytes 115 Packets received: 89 │ TX succeeded 3 errors 0 Packets received: 90 │ Statistics for IPv6 Packets received: 91 │ RX packets 0 bytes 0 Packets received: 92 │ TX packets 3 (Multicast: 3) bytes 178 Packets received: 93 │ TX succeeded 3 errors 0 Packets received: 94 │ Packets received: 95 │> ifconfig 6 l2filter add 06:A5:F7:65:10:6B:11:15 Packets received: 96 │ifconfig 6 l2filter add 06:A5:F7:65:10:6B:11:15 Packets received: 97 │successfully added address to filter Packets received: 98 │> ifconfig 6 l2filter add 1A:AB:F9:65:10:6B:11:15 Packets received: 99 │ifconfig 6 l2filter add 1A:AB:F9:65:10:6B:11:15 Packets received: 100 │successfully added address to filter │> ─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────── kevinweiss@kevinweisswork:~/WorkingDirectory/RIOT$ USEMODULE=gnrc_pktbuf_cmd make -C tests/gnrc_udp/ flash-only term │Success: send 50 byte to [abcd::1]:1234 make: Entering directory '/home/kevinweiss/WorkingDirectory/RIOT/tests/gnrc_udp' │Success: send 50 byte to [abcd::1]:1234 iotlab-node --jmespath='keys(@)[0]' --format='int' --list grenoble,m3,306 --update /home/kevinweiss/WorkingDirectory/RIOT/tests/gnrc_udp│Success: send 50 byte to [abcd::1]:1234 /bin/iotlab-m3/tests_gnrc_udp.elf | grep 0 │Success: send 50 byte to [abcd::1]:1234 0 │Success: send 50 byte to [abcd::1]:1234 ssh -t weoss@grenoble.iot-lab.info 'socat - tcp:m3-306.grenoble.iot-lab.info:20000' │Success: send 50 byte to [abcd::1]:1234 ifconfig │Success: send 50 byte to [abcd::1]:1234 ifconfig │Success: send 50 byte to [abcd::1]:1234 Iface 6 HWaddr: 11:15 Channel: 26 Page: 0 NID: 0x23 │Success: send 50 byte to [abcd::1]:1234 Long HWaddr: 06:A5:F7:65:10:6B:11:15 │Success: send 50 byte to [abcd::1]:1234 TX-Power: 0dBm State: IDLE max. Retrans.: 3 CSMA Retries: 4 │Success: send 50 byte to [abcd::1]:1234 AUTOACK ACK_REQ CSMA L2-PDU:102 MTU:1280 HL:64 RTR │Success: send 50 byte to [abcd::1]:1234 6LO IPHC │Success: send 50 byte to [abcd::1]:1234 Source address length: 8 │Success: send 50 byte to [abcd::1]:1234 Link type: wireless │Success: send 50 byte to [abcd::1]:1234 inet6 addr: fe80::4a5:f765:106b:1115 scope: link VAL │Success: send 50 byte to [abcd::1]:1234 inet6 group: ff02::2 │Success: send 50 byte to [abcd::1]:1234 inet6 group: ff02::1 │Success: send 50 byte to [abcd::1]:1234 inet6 group: ff02::1:ff6b:1115 │Success: send 50 byte to [abcd::1]:1234 inet6 group: ff02::1a │Success: send 50 byte to [abcd::1]:1234 │Success: send 50 byte to [abcd::1]:1234 White-listed link layer addresses: │Success: send 50 byte to [abcd::1]:1234 --- none --- │Success: send 50 byte to [abcd::1]:1234 │Success: send 50 byte to [abcd::1]:1234 Statistics for Layer 2 │Success: send 50 byte to [abcd::1]:1234 RX packets 6 bytes 230 │Success: send 50 byte to [abcd::1]:1234 TX packets 3 (Multicast: 3) bytes 115 │Success: send 50 byte to [abcd::1]:1234 TX succeeded 3 errors 0 │Success: send 50 byte to [abcd::1]:1234 Statistics for IPv6 │Success: send 50 byte to [abcd::1]:1234 RX packets 0 bytes 0 │Success: send 50 byte to [abcd::1]:1234 TX packets 3 (Multicast: 3) bytes 178 │Success: send 50 byte to [abcd::1]:1234 TX succeeded 3 errors 0 │Success: send 50 byte to [abcd::1]:1234 │Success: send 50 byte to [abcd::1]:1234 > ifconfig 6 l2filter add 32:5E:FA:65:10:6B:11:15 │Success: send 50 byte to [abcd::1]:1234 ifconfig 6 l2filter add 32:5E:FA:65:10:6B:11:15 │Success: send 50 byte to [abcd::1]:1234 successfully added address to filter │Success: send 50 byte to [abcd::1]:1234 > ifconfig 6 l2filter add 1A:AD:F6:65:10:6B:11:15 │Success: send 50 byte to [abcd::1]:1234 ifconfig 6 l2filter add 1A:AD:F6:65:10:6B:11:15 │Success: send 50 byte to [abcd::1]:1234 successfully added address to filter │Success: send 50 byte to [abcd::1]:1234 > │>
fjmolinas commented 4 years ago
04-single-hop-6lowpan-icmp Task 5 Passes ``` fe80::212:4b00:14d5:2d91: icmp_seq=999 ttl=64 rssi=-71 dBm time=9.757 ms 2020-01-16 17:01:25,175 # 2020-01-16 17:01:25,179 # --- fe80::212:4b00:14d5:2d91 PING statistics --- 2020-01-16 17:01:25,184 # 1000 packets transmitted, 991 packets received, 0% packet loss 2020-01-16 17:01:25,188 # round-trip min/avg/max = 9.757/9.760/9.804 ms > 2020-01-16 17:01:28,243 # pktbuf 2020-01-16 17:01:28,249 # packet buffer: first byte: 0x1fffdbd4, last byte: 0x1ffff3d4 (size: 6144) 2020-01-16 17:01:28,252 # position of last byte used: 328 2020-01-16 17:01:28,257 # ~ unused: 0x1fffdbd4 (next: (nil), size: 6144) ~ > 2020-01-16 17:01:31,329 # pktbuf 2020-01-16 17:01:31,330 # packet buffer: first byte: 0x20001918, last byte: 0x20003118 (size: 6144) 2020-01-16 17:01:31,331 # position of last byte used: 392 2020-01-16 17:01:31,332 # ~ unused: 0x20001918 (next: (nil), size: 6144) ~ fe80::d1c1:6d4e:ab6a:1336: icmp_seq=999 ttl=64 time=9.773 ms 2020-01-16 17:03:14,393 # 2020-01-16 17:03:14,409 # --- fe80::d1c1:6d4e:ab6a:1336 PING statistics --- 2020-01-16 17:03:14,412 # 1000 packets transmitted, 982 packets received, 1% packet loss 2020-01-16 17:03:14,414 # round-trip min/avg/max = 9.770/9.772/9.804 ms > 2020-01-16 17:03:17,485 # pktbuf 2020-01-16 17:03:17,488 # packet buffer: first byte: 0x20001918, last byte: 0x20003118 (size: 6144) 2020-01-16 17:03:17,490 # position of last byte used: 368 2020-01-16 17:03:17,491 # ~ unused: 0x20001918 (next: (nil), size: 6144) ~ > 2020-01-16 17:03:20,550 # pktbuf 2020-01-16 17:03:20,556 # packet buffer: first byte: 0x1fffdbd4, last byte: 0x1ffff3d4 (size: 6144) 2020-01-16 17:03:20,559 # position of last byte used: 392 2020-01-16 17:03:20,564 # ~ unused: 0x1fffdbd4 (next: (nil), size: 6144) ~ . ```
MrKevinWeiss commented 4 years ago

@miri64 ping

Task 05 (Experimental) - UDP with large payload on iotlab-m3 with three hops (RPL route) FAILED as last release ``` =========== chunk 1 (0x2000229c size: 24) =========== │0 00000000 6C 22 00 20 74 24 00 20 08 00 00 00 01 00 00 00 │ssh -t weoss@grenoble.iot-lab.info 'socat - tcp:m3-305.grenoble.iot-lab.info:20000' 00000010 03 23 00 20 20 00 00 00 │ifconfig ~ unused: 0x200022b4 (next: 0x200022e4, size: 24) ~ │ifconfig =========== chunk 2 (0x200022cc size: 24) =========== │Iface 6 HWaddr: 11:15 Channel: 26 Page: 0 NID: 0x23 00000000 B4 22 00 20 DC 2E 00 20 08 00 00 00 01 00 00 00 │ Long HWaddr: 1A:AD:F6:65:10:6B:11:15 00000010 03 AB F9 65 10 6B 11 15 │ TX-Power: 0dBm State: IDLE max. Retrans.: 3 CSMA Retries: 4 ~ unused: 0x200022e4 (next: 0x2000235c, size: 48) ~ │ AUTOACK ACK_REQ CSMA L2-PDU:102 MTU:1280 HL:64 RTR =========== chunk 3 (0x20002314 size: 72) =========== │ 6LO IPHC 00000000 E4 22 00 20 0C 2F 00 20 08 00 00 00 01 00 00 00 │ Source address length: 8 00000010 03 65 F6 AD 1A E3 68 00 FC 22 00 20 3C 2F 00 20 │ Link type: wireless 00000020 08 00 00 00 01 00 00 00 03 65 F6 AD 1A E3 68 00 │ inet6 addr: fe80::18ad:f665:106b:1115 scope: link VAL 00000030 E4 22 00 20 6C 2F 00 20 08 00 00 00 01 00 00 00 │ inet6 group: ff02::2 00000040 03 65 F6 AD 1A E3 68 00 │ inet6 group: ff02::1 ~ unused: 0x2000235c (next: 0x20002374, size: 16) ~ │ inet6 group: ff02::1:ff6b:1115 =========== chunk 4 (0x2000236c size: 8) =========== │ inet6 group: ff02::1a 00000000 11 00 04 D0 F9 4E 1E 20 │ ~ unused: 0x20002374 (next: 0x200023a4, size: 24) ~ │ White-listed link layer addresses: =========== chunk 5 (0x2000238c size: 24) =========== │ --- none --- 00000000 74 23 00 20 A4 24 00 20 08 00 00 00 01 00 00 00 │ 00000010 03 23 00 20 18 00 00 00 │ Statistics for Layer 2 ~ unused: 0x200023a4 (next: 0x2000247c, size: 208) ~ │ RX packets 3 bytes 115 =========== chunk 6 (0x20002474 size: 8) =========== │ TX packets 3 (Multicast: 3) bytes 115 00000000 11 00 04 D0 F9 4E 21 06 │ TX succeeded 3 errors 0 ~ unused: 0x2000247c (next: 0x200024ac, size: 40) ~ │ Statistics for IPv6 =========== chunk 7 (0x200024a4 size: 8) =========== │ RX packets 0 bytes 0 00000000 11 00 04 D0 F9 4E 21 39 │ TX packets 3 (Multicast: 3) bytes 178 ~ unused: 0x200024ac (next: 0x20002ee4, size: 2608) ~ │ TX succeeded 3 errors 0 =========== chunk 8 (0x20002edc size: 8) =========== │ 00000000 11 00 04 D0 F9 4E 1E 9A │> ifconfig 6 l2filter add 06:A5:F7:65:10:6B:11:15 ~ unused: 0x20002ee4 (next: 0x20002f14, size: 40) ~ │ifconfig 6 l2filter add 06:A5:F7:65:10:6B:11:15 =========== chunk 9 (0x20002f0c size: 8) =========== │successfully added address to filter 00000000 11 00 04 D0 F9 4E 1F 75 │> ifconfig 6 l2filter add 1A:AB:F9:65:10:6B:11:15 ~ unused: 0x20002f14 (next: 0x20002f44, size: 40) ~ │ifconfig 6 l2filter add 1A:AB:F9:65:10:6B:11:15 =========== chunk 10 (0x20002f3c size: 8) =========== │successfully added address to filter 00000000 11 00 04 D0 F9 4E 1F 97 │> pktbuf ~ unused: 0x20002f44 (next: 0x20002f74, size: 40) ~ │pktbuf =========== chunk 11 (0x20002f6c size: 8) =========== │packet buffer: first byte: 0x20002224, last byte: 0x20004224 (size: 8192) 00000000 11 00 04 D0 F9 4E 1F BD │ position of last byte used: 7248 ~ unused: 0x20002f74 (next: (nil), size: 4784) ~ │~ unused: 0x20002224 (next: (nil), size: 8192) ~ > │> ─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────── ssh -t weoss@grenoble.iot-lab.info 'socat - tcp:m3-306.grenoble.iot-lab.info:20000' │00000090 CC 22 00 20 7C 25 00 20 08 00 00 00 01 00 00 00 ifconfig │000000A0 03 65 F7 A5 06 E3 68 00 E4 22 00 20 04 31 00 20 ifconfig │000000B0 08 00 00 00 01 00 00 00 03 65 F7 A5 06 E3 68 00 Iface 6 HWaddr: 11:15 Channel: 26 Page: 0 NID: 0x23 │000000C0 CC 22 00 20 34 31 00 20 08 00 00 00 01 00 00 00 Long HWaddr: 06:A5:F7:65:10:6B:11:15 │000000D0 03 65 F7 A5 06 E3 68 00 TX-Power: 0dBm State: IDLE max. Retrans.: 3 CSMA Retries: 4 │~ unused: 0x200023d4 (next: 0x20002404, size: 40) ~ AUTOACK ACK_REQ CSMA L2-PDU:102 MTU:1280 HL:64 RTR │=========== chunk 3 (0x200023fc size: 8) =========== 6LO IPHC │00000000 11 00 04 D0 34 92 65 09 Source address length: 8 │~ unused: 0x20002404 (next: 0x20002494, size: 136) ~ Link type: wireless │=========== chunk 4 (0x2000248c size: 8) =========== inet6 addr: fe80::4a5:f765:106b:1115 scope: link VAL │00000000 11 00 04 D0 34 92 65 8B inet6 group: ff02::2 │~ unused: 0x20002494 (next: 0x200024c4, size: 40) ~ inet6 group: ff02::1 │=========== chunk 5 (0x200024bc size: 8) =========== inet6 group: ff02::1:ff6b:1115 │00000000 11 00 04 D0 34 92 65 8D inet6 group: ff02::1a │~ unused: 0x200024c4 (next: 0x200024f4, size: 40) ~ │=========== chunk 6 (0x200024ec size: 8) =========== White-listed link layer addresses: │00000000 11 00 04 D0 34 92 65 E4 --- none --- │~ unused: 0x200024f4 (next: 0x20002524, size: 40) ~ │=========== chunk 7 (0x2000251c size: 8) =========== Statistics for Layer 2 │00000000 11 00 04 D0 34 92 66 19 RX packets 6 bytes 230 │~ unused: 0x20002524 (next: 0x20002554, size: 40) ~ TX packets 3 (Multicast: 3) bytes 115 │=========== chunk 8 (0x2000254c size: 8) =========== TX succeeded 3 errors 0 │00000000 11 00 04 D0 34 92 66 AB Statistics for IPv6 │~ unused: 0x20002554 (next: 0x20002584, size: 40) ~ RX packets 0 bytes 0 │=========== chunk 9 (0x2000257c size: 8) =========== TX packets 3 (Multicast: 3) bytes 178 │00000000 11 00 04 D0 34 92 67 23 TX succeeded 3 errors 0 │~ unused: 0x20002584 (next: 0x200028d4, size: 840) ~ │=========== chunk 10 (0x200028cc size: 8) =========== > ifconfig 6 l2filter add 32:5E:FA:65:10:6B:11:15 │00000000 11 00 04 D0 34 92 64 D8 ifconfig 6 l2filter add 32:5E:FA:65:10:6B:11:15 │~ unused: 0x200028d4 (next: 0x20002904, size: 40) ~ successfully added address to filter │=========== chunk 11 (0x200028fc size: 8) =========== > ifconfig 6 l2filter add 1A:AD:F6:65:10:6B:11:15 │00000000 11 00 04 D0 34 92 69 8C ifconfig 6 l2filter add 1A:AD:F6:65:10:6B:11:15 │~ unused: 0x20002904 (next: 0x2000310c, size: 2048) ~ successfully added address to filter │=========== chunk 12 (0x20003104 size: 8) =========== > pktbuf │00000000 11 00 04 D0 34 92 67 54 OiAweDIwMDAzMTBjIChuZXh0OiAweDIwMDAzMTNjLCBzaXplOiAgIDQwKSB+Cj09PT09PT09PT09IGNodW5rICAxMyAoMHgyMDAwMzEzNCBzaXplOiAgICA4KSA9PT09PT09PT09PQ~ unused: 0x2000310c (next: 0x2000313c, size: 40) ~ packet buffer: first byte: 0x20002224, last byte: 0x20004224 (size: 8192) │=========== chunk 13 (0x20003134 size: 8) =========== position of last byte used: 7288 │00000000 11 00 04 D0 34 92 67 82 ~ unused: 0x20002224 (next: (nil), size: 8192) ~ │~ unused: 0x2000313c (next: (nil), size: 4328) ~
fjmolinas commented 4 years ago

I'm having a weird behaviour with remote-revb where shell reboot causes a hardfault on one of my setups, but not both... I;m investigating.

fjmolinas commented 4 years ago

I'm having issues with task10, it has succeeded a couple of times but most of the time the buffer doesn't empty completely.

04-single-hop-6lowpan-icmp Task 10 FAILS ``` fe80::24bc:fb65:106b:1115 PING statistics --- 200 packets transmitted, 199 packets received, 0% packet loss round-trip min/avg/max = 256.637/278.488/292.799 ms > pktbuf packet buffer: first byte: 0x20001a10, last byte: 0x20003a10 (size: 8192) position of last byte used: 5872 ~ unused: 0x20001a10 (next: (nil), size: 8192) ~ > pktbuf packet buffer: first byte: 0x20001a10, last byte: 0x20003a10 (size: 8192) position of last byte used: 4592 ~ unused: 0x20001a10 (next: (nil), size: 8192) ~ fe80::34bc:fd65:106b:1115: icmp_seq=199 ttl=64 rssi=-42 dBm time=284.791 ms --- fe80::34bc:fd65:106b:1115 PING statistics --- 200 packets transmitted, 198 packets received, 1% packet loss round-trip min/avg/max = 257.576/278.287/292.683 ms > pktbuf packet buffer: first byte: 0x20001a10, last byte: 0x20003a10 (size: 8192) position of last byte used: 5872 ~ unused: 0x20001a10 (next: (nil), size: 8192) ~ > pktbuf packet buffer: first byte: 0x20001a10, last byte: 0x20003a10 (size: 8192) position of last byte used: 5872 ~ unused: 0x20001a10 (next: (nil), size: 8192) ~ ``` ``` pktbuf packet buffer: first byte: 0x20001a10, last byte: 0x20003a10 (size: 8192) position of last byte used: 7976 ~ unused: 0x20001a10 (next: 0x20001ab8, size: 120) ~ =========== chunk 0 (0x20001a88 size: 48) =========== 00000000 70 1A 00 20 B8 20 00 20 08 00 00 00 01 00 00 00 00000010 03 AD FC 65 10 6B 11 15 70 1A 00 20 E8 20 00 20 00000020 08 00 00 00 01 00 00 00 03 65 FC BD 52 E3 68 01 ~ unused: 0x20001ab8 (next: 0x200020c0, size: 1536) ~ =========== chunk 1 (0x200020b8 size: 8) =========== 00000000 3A 00 04 D0 3F FE CF D7 ~ unused: 0x200020c0 (next: 0x200020f0, size: 40) ~ =========== chunk 2 (0x200020e8 size: 8) =========== 00000000 3A 00 04 D0 3F FE D8 8E ~ unused: 0x200020f0 (next: (nil), size: 6432) ~ ```
miri64 commented 4 years ago

How soon after the test and how often did you run pktbuf?

fjmolinas commented 4 years ago

How soon after the test and how often did you run pktbuf?

Immediately after, every 3 seconds for about 1000s. When it succeeded it was empty in the first 10s after pings where over.

fjmolinas commented 4 years ago

@JulianHolzwarth should be able to provide some info as he AFAIK sits right next to it and used it before

I think many of the boards are unplugged, @JulianHolzwarth can you confirm which ones are not?

miri64 commented 4 years ago

I replugged some I saw were unplugged, but most of them were still running:

IMG_20200117_100538334

miri64 commented 4 years ago

How soon after the test and how often did you run pktbuf?

Immediately after, every 3 seconds for about 1000s. When it succeeded it was empty in the first 10s after pings where over.

Will have a look.

miri64 commented 4 years ago
I had a very similar result when testing this morning ``` 1579257942.071813;m3-101;pktbuf 1579257942.073407;m3-101;packet buffer: first byte: 0x2000205c, last byte: 0x2000405c (size: 8192) 1579257942.074302;m3-101; position of last byte used: 7976 1579257942.075239;m3-101;~ unused: 0x2000205c (next: 0x20002104, size: 120) ~ 1579257942.076284;m3-101;=========== chunk 0 (0x200020d4 size: 48) =========== 1579257942.078218;m3-101;00000000 BC 20 00 20 04 27 00 20 08 00 00 00 01 00 00 00 1579257942.079313;m3-101;00000010 03 5D F6 65 10 6B 11 15 BC 20 00 20 34 27 00 20 1579257942.081215;m3-101;00000020 08 00 00 00 01 00 00 00 03 65 FC 5C 22 E3 68 01 1579257942.082222;m3-101;~ unused: 0x20002104 (next: 0x2000270c, size: 1536) ~ 1579257942.083242;m3-101;=========== chunk 1 (0x20002704 size: 8) =========== 1579257942.084235;m3-101;00000000 3A 00 04 D0 E3 24 BD 33 1579257942.085219;m3-101;~ unused: 0x2000270c (next: 0x2000273c, size: 40) ~ 1579257942.087222;m3-101;=========== chunk 2 (0x20002734 size: 8) =========== 1579257942.088215;m3-101;00000000 3A 00 04 D0 E3 24 C6 8D 1579257942.089210;m3-101;~ unused: 0x2000273c (next: (nil), size: 6432) ~ ```

Even the unused sections are the same (the only numbers different are the pointers, the datagram identifier in the fragment header and unused memory padding within the allocated chunks). The data in chunk 0 are two gnrc_pktsnip_t instances of type NETTYPE_GNRC_IPV6_EXT with their data pointer pointing to chunk 1 and chunk 2 (both IPv6 fragmentation headers) respectively. The next pointer of both points to the same address somewhere in the unsused section, so that part is lost. The fragmentation headers are for the second fragment each, having an offset of 1232. I have a hunch where the problem might be, but need to look deeper for final confirmation.

miri64 commented 4 years ago

All in all, this also seems to be broken in 2019.10 (since the last change to the fragmentation was https://github.com/RIOT-OS/RIOT/pull/12414)

PeterKietzmann commented 4 years ago
03-single-hop-ipv6-icmp Task 1 Passes ``` ping6 -c 1000 -i 10 -s 0 ff02::1 8 bytes from fe80::20d6:36ff:fedc:6107: icmp_seq=0 ttl=64 8 bytes from fe80::a0c0:1aff:fe0f:675e: icmp_seq=0 ttl=64 (DUP!) 8 bytes from fe80::20d6:36ff:fedc:6107: icmp_seq=1 ttl=64 8 bytes from fe80::a0c0:1aff:fe0f:675e: icmp_seq=1 ttl=64 (DUP!) ... --- ff02::1 PING statistics --- 1000 packets transmitted, 1000 packets received, 999 duplicates, 0% packet loss ```
PeterKietzmann commented 4 years ago

I don't quite remember if it is normal to receive ping responses from the tap bridge in native?

PeterKietzmann commented 4 years ago
03-single-hop-ipv6-icmp Task 2 Passes ``` ping6 -c 1000 -i 100 -s 1000 fe80::20d6:36ff:fedc:6108 1008 bytes from fe80::20d6:36ff:fedc:6108: icmp_seq=0 ttl=64 time=1.195 ms 1008 bytes from fe80::20d6:36ff:fedc:6108: icmp_seq=1 ttl=64 time=0.915 ms 1008 bytes from fe80::20d6:36ff:fedc:6108: icmp_seq=2 ttl=64 time=1.097 ms 1008 bytes from fe80::20d6:36ff:fedc:6108: icmp_seq=3 ttl=64 time=1.210 ms 1008 bytes from fe80::20d6:36ff:fedc:6108: icmp_seq=4 ttl=64 time=1.098 ms 1008 bytes from fe80::20d6:36ff:fedc:6108: icmp_seq=5 ttl=64 time=1.090 ms 1008 bytes from fe80::20d6:36ff:fedc:6108: icmp_seq=6 ttl=64 time=1.103 ms 1008 bytes from fe80::20d6:36ff:fedc:6108: icmp_seq=7 ttl=64 time=1.096 ms 1008 bytes from fe80::20d6:36ff:fedc:6108: icmp_seq=8 ttl=64 time=1.351 ms 1008 bytes from fe80::20d6:36ff:fedc:6108: icmp_seq=9 ttl=64 time=1.300 ms ... --- fe80::20d6:36ff:fedc:6108 PING statistics --- 1000 packets transmitted, 1000 packets received, 0% packet loss round-trip min/avg/max = 0.213/1.016/2.763 ms ```
PeterKietzmann commented 4 years ago
01-ci Task 4 Passes ``` 1579277196.964771;m3-95;Help: Press s to start test, r to print it is ready s 1579277196.964771;m3-95;Help: Press s to start test, r to print it is ready 1579277202.717783;m3-95;START 1579277213.805054;m3-95;............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................... 1579277213.805197;m3-95;OK (959 tests) ```
miri64 commented 4 years ago

Even the unused sections are the same (the only numbers different are the pointers, the datagram identifier in the fragment header and unused memory padding within the allocated chunks). The data in chunk 0 are two gnrc_pktsnip_t instances of type NETTYPE_GNRC_IPV6_EXT with their data pointer pointing to chunk 1 and chunk 2 (both IPv6 fragmentation headers) respectively. The next pointer of both points to the same address somewhere in the unsused section, so that part is lost. The fragmentation headers are for the second fragment each, having an offset of 1232. I have a hunch where the problem might be, but need to look deeper for final confirmation.

It appears to be happening when the first fragment of the echo reply is lost. However, the bug is heisenbuggy enough that I don't loose the first fragment, when I try to find out what is happening to the first fragment :-/. Will investigate further though.

PeterKietzmann commented 4 years ago
03-single-hop-ipv6-icmp Task 3 Passes ``` ping6 -c 3600 -i 1000 -s 1000 fe80::20d6:36ff:fedc:6108 1008 bytes from fe80::20d6:36ff:fedc:6108: icmp_seq=0 ttl=64 time=1.402 ms 1008 bytes from fe80::20d6:36ff:fedc:6108: icmp_seq=1 ttl=64 time=1.608 ms 1008 bytes from fe80::20d6:36ff:fedc:6108: icmp_seq=2 ttl=64 time=1.001 ms 1008 bytes from fe80::20d6:36ff:fedc:6108: icmp_seq=3 ttl=64 time=1.016 ms 1008 bytes from fe80::20d6:36ff:fedc:6108: icmp_seq=4 ttl=64 time=0.312 ms 1008 bytes from fe80::20d6:36ff:fedc:6108: icmp_seq=5 ttl=64 time=0.694 ms 1008 bytes from fe80::20d6:36ff:fedc:6108: icmp_seq=6 ttl=64 time=1.033 ms 1008 bytes from fe80::20d6:36ff:fedc:6108: icmp_seq=7 ttl=64 time=1.222 ms 1008 bytes from fe80::20d6:36ff:fedc:6108: icmp_seq=8 ttl=64 time=0.653 ms ... --- fe80::20d6:36ff:fedc:6108 PING statistics --- 3600 packets transmitted, 3600 packets received, 0% packet loss round-trip min/avg/max = 0.211/1.136/2.682 ms ```
miri64 commented 4 years ago

It appears to be happening when the first fragment of the echo reply is lost. However, the bug is heisenbuggy enough that I don't loose the first fragment, when I try to find out what is happening to the first fragment :-/. Will investigate further though.

Fixed here https://github.com/RIOT-OS/RIOT/pull/13156

miri64 commented 4 years ago

@miri64 ping Task 05 (Experimental) - UDP with large payload on iotlab-m3 with three hops (RPL route) FAILED as last release

And will continue to, unless we have a congestion avoiding MAC layer. See https://github.com/RIOT-OS/Release-Specs/issues/142#issuecomment-561677974.

kb2ma commented 4 years ago
09-coap Task 01 - CORD Endpoint PASS ``` > cord_ep register [fd00:bbbb::1] cord_ep register [fd00:bbbb::1] Registering with RD now, this may take a short while... RD endpoint event: now registered with a RD registration successful CoAP RD connection status: RD address: coap://[fd00:bbbb::1]:5683 ep name: RIOT-7E0723237E072323 lifetime: 60s reg if: /resourcedirectory location: /reg/1/ > RD endpoint event: successfully updated client registration ```
09-coap Task 02 - Confirmable retries PASS ![coap-task2](https://user-images.githubusercontent.com/2944058/72665433-79f36400-39d6-11ea-9fc9-20a163a2bc94.png)
09-coap Task 03 - Block1 PASS ``` $ ./task03.py -r [fe80::200:bbff:febb:2%tap0] -b 32 Result: 2.04 Changed b'BEF6D998FB07110712EC8DC5AF83EE399EAC875F7FE44423348A0E0D8254C8AA' ```
kb2ma commented 4 years ago
09-coap Task 04 - Block2 PASS ``` $ ./task04.py -r [fe80::200:bbff:febb:2%tap0] -b 64 Result: 2.05 Content b'This is RIOT (Version: 2020.04-devel-HEAD) running on a native board with a native MCU.' ```
09-coap Task 05 - Observe registration and notification PASS ``` $ ./task05.py -r [fd00:bbbb::2] First response: , 2 option(s), 1 byte(s) payload> b'0' Next result: , 2 option(s), 1 byte(s) payload> b'1' Loop ended, wait 10 sec ```
fjmolinas commented 4 years ago
04-single-hop-6lowpan-icmp Task 6 Passes ``` 04-single-hop-6lowpan-icmp/test.py ................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................... fe80::212:4b00:14d5:2d91: icmp_seq=999 ttl=64 rssi=-73 dBm time=9.987 ms 2020-01-20 09:28:07,060 # 2020-01-20 09:28:07,063 # --- ff02::1 PING statistics --- 2020-01-20 09:28:07,068 # 1000 packets transmitted, 995 packets received, 0% packet loss 2020-01-20 09:28:07,073 # round-trip min/avg/max = 9.350/10.487/15.566 ms > 2020-01-20 09:28:10,128 # pktbuf 2020-01-20 09:28:10,134 # packet buffer: first byte: 0x200019a0, last byte: 0x200031a0 (size: 6144) 2020-01-20 09:28:10,137 # position of last byte used: 432 2020-01-20 09:28:10,142 # ~ unused: 0x200019a0 (next: (nil), size: 6144) ~ > 2020-01-20 09:28:13,212 # pktbuf 2020-01-20 09:28:13,215 # packet buffer: first byte: 0x20001918, last byte: 0x20003118 (size: 6144) 2020-01-20 09:28:13,216 # position of last byte used: 384 2020-01-20 09:28:13,218 # ~ unused: 0x20001918 (next: (nil), size: 6144) ~ ....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................... fe80::806b:deec:5834:6579: icmp_seq=999 ttl=64 time=9.217 ms 2020-01-20 09:29:54,590 # 2020-01-20 09:29:54,604 # --- ff02::1 PING statistics --- 2020-01-20 09:29:54,606 # 1000 packets transmitted, 999 packets received, 0% packet loss 2020-01-20 09:29:54,608 # round-trip min/avg/max = 9.192/10.345/17.163 ms > 2020-01-20 09:29:57,679 # pktbuf 2020-01-20 09:29:57,682 # packet buffer: first byte: 0x20001918, last byte: 0x20003118 (size: 6144) 2020-01-20 09:29:57,684 # position of last byte used: 464 2020-01-20 09:29:57,685 # ~ unused: 0x20001918 (next: (nil), size: 6144) ~ > 2020-01-20 09:30:00,744 # pktbuf 2020-01-20 09:30:00,750 # packet buffer: first byte: 0x200019a0, last byte: 0x200031a0 (size: 6144) 2020-01-20 09:30:00,753 # position of last byte used: 432 2020-01-20 09:30:00,757 # ~ unused: 0x200019a0 (next: (nil), size: 6144) ~ . =================================================================================================================== 1 passed, 9 deselected in 256.03s (0:04:16) =================================================================================================================== ```
fjmolinas commented 4 years ago

It seems like I am getting some trouble with the arduino board. The same init problems and when it does init I cannot ping at all...

Originally posted by @MrKevinWeiss in https://github.com/RIOT-OS/Release-Specs/issues/142#issuecomment-545359685

@MrKevinWeiss it seems I'm having the same issues with xbee as you had before, can you tell me how you made it work?

fjmolinas commented 4 years ago
11-lorawan Task 1 Passes ``` 11-lorawan/test.py ssh -t molina@saclay.iot-lab.info 'socat - tcp:st-lrwan1-13.saclay.iot-lab.info:20000' main(): This is RIOT! (Version: 2020.04-devel-2-gb77da-pr_loramac_tests) LoRaWAN Class A low-power application ===================================== Starting join procedure Join procedure succeeded Sending: This is RIOT! Sending: This is RIOT! Sending: This is RIOT! Sending: This is RIOT! Sending: This is RIOT! ``` ![image](https://user-images.githubusercontent.com/23060007/66737142-74ccc900-ee6b-11e9-9432-8c1cf7d8daec.png) ![image](https://user-images.githubusercontent.com/23060007/72718487-56671f80-3b76-11ea-900c-d04f18a21f34.png)
leandrolanzieri commented 4 years ago
10-icmpv6-error Task 01 - Destination unreachable - no route to destination: PASS ``` >>> srp1(Ether() / IPv6(src="beef::1", dst="affe::1") / UDP(dport=48879) , iface="tapbr0") Begin emission: .Finished sending 1 packets. * Received 2 packets, got 1 answers, remaining 0 packets >>>>> ```
leandrolanzieri commented 4 years ago
10-icmpv6-error Task 02 - Destination unreachable - Beyond scope of source address: PASS ``` >>> srp1(Ether() / IPv6(src="fe80::38c5:26ff:fecc:368b", dst="affe::1") / UDP(dport=48879) , iface="tapbr0") Begin emission: .Finished sending 1 packets. * Received 2 packets, got 1 answers, remaining 0 packets >>>>> ```
leandrolanzieri commented 4 years ago
10-icmpv6-error Task 03 - Destination unreachable - address unreachable (target node address): PASS ``` >>> srp1(Ether(dst="3A:C5:26:CC:36:8C") / IPv6(src="fe80::38c5:26ff:fecc:368b", dst="fe80::1") / UDP(dport=48879) , iface="tapbr0") Begin emission: Finished sending 1 packets. * Received 1 packets, got 1 answers, remaining 0 packets >>>>>>>> ```
fjmolinas commented 4 years ago
11-lorawan Task 2 Passes ``` loramac erase > loramac erase > reboot reboot main(): This is RIOT! (Version: 2020.04-devel-2-gb77da-pr_loramac_tests) All up, running the shell now >loramac set deveui 00D23F63A8D87783 loramac set deveui 00D23F63A8D87783 > loramac set appeui 70B3D57ED00204EC loramac set appeui 70B3D57ED00204EC > loramac set appkey 0A3E1510AEB8DB583B10DCA691522409 loramac set appkey 0A3E1510AEB8DB583B10DCA691522409 > loramac set dr 0 loramac set dr 0 > loramac join otaa loramac join otaa Join procedure succeeded! > loramac tx "This is RIOT" cnf 123 loramac tx "This is RIOT" cnf 123 Received ACK from network Message sent with success > loramac tx "This is RIOT" uncnf 42 loramac tx "This is RIOT" uncnf 42 Message sent with success > reboot reboot main(): This is RIOT! (Version: 2020.04-devel-2-gb77da-pr_loramac_tests) All up, running the shell now > loramac set deveui 00D23F63A8D87783 loramac set deveui 00D23F63A8D87783 > loramac set appeui 70B3D57ED00204EC loramac set appeui 70B3D57ED00204EC > loramac set appkey 0A3E1510AEB8DB583B10DCA691522409 loramac set appkey 0A3E1510AEB8DB583B10DCA691522409 > loramac set dr 3 loramac set dr 3 > loramac join otaa loramac join otaa Join procedure succeeded! > loramac tx "This is RIOT" cnf 123 loramac tx "This is RIOT" cnf 123 Received ACK from network Message sent with success > loramac tx "This is RIOT" uncnf 42 loramac tx "This is RIOT" uncnf 42 Message sent with success > reboot reboot main(): This is RIOT! (Version: 2020.04-devel-2-gb77da-pr_loramac_tests) All up, running the shell now > loramac set deveui 00D23F63A8D87783 loramac set deveui 00D23F63A8D87783 > loramac set appeui 70B3D57ED00204EC loramac set appeui 70B3D57ED00204EC > loramac set appkey 0A3E1510AEB8DB583B10DCA691522409 loramac set appkey 0A3E1510AEB8DB583B10DCA691522409 >loramac set dr 5 loramac set dr 5 > loramac join otaa loramac join otaa Join procedure succeeded! > loramac tx "This is RIOT" cnf 123 loramac tx "This is RIOT" cnf 123 Received ACK from network Message sent with success > loramac tx "This is RIOT" uncnf 42 loramac tx "This is RIOT" uncnf 42 Message sent with success > reboot reboot main(): This is RIOT! (Version: 2020.04-devel-2-gb77da-pr_loramac_tests) All up, running the shell now >TEST PASSED ``` ![image](https://user-images.githubusercontent.com/23060007/72725517-3e979780-3b86-11ea-9c21-fb40d6b33311.png)
11-lorawan Task 3 Passes ``` main(): This is RIOT! (Version: 2020.04-devel-2-gb77da-pr_loramac_tests) All up, running the shell now > r READY > s s START > loramac erase loramac erase > reboot reboot main(): This is RIOT! (Version: 2020.04-devel-2-gb77da-pr_loramac_tests) All up, running the shell now > loramac set deveui 00D23F63A8D87782 loramac set deveui 00D23F63A8D87782 > loramac set appeui 70B3D57ED00204EC loramac set appeui 70B3D57ED00204EC > loramac set devaddr 2601107E loramac set devaddr 2601107E > loramac set nwkskey 6CCC73B2681EC60142C5D4933BFE8D34 loramac set nwkskey 6CCC73B2681EC60142C5D4933BFE8D34 > loramac set appskey 07683C44D66D201B557B0DF7EFEF8391 loramac set appskey 07683C44D66D201B557B0DF7EFEF8391 > loramac set rx2_dr 3 loramac set rx2_dr 3 > loramac set dr 0 loramac set dr 0 > loramac join abp loramac join abp Join procedure succeeded! > loramac tx "This is RIOT" cnf 123 loramac tx "This is RIOT" cnf 123 Received ACK from network Message sent with success > loramac tx "This is RIOT" uncnf 42 loramac tx "This is RIOT" uncnf 42 Message sent with success > loramac get ul_cnt loramac get ul_cnt Uplink Counter: 2 > reboot reboot main(): This is RIOT! (Version: 2020.04-devel-2-gb77da-pr_loramac_tests) All up, running the shell now > loramac set ul_cnt 2 loramac set ul_cnt 2 > loramac set deveui 00D23F63A8D87782 loramac set deveui 00D23F63A8D87782 >loramac set appeui 70B3D57ED00204EC loramac set appeui 70B3D57ED00204EC > loramac set devaddr 2601107E loramac set devaddr 2601107E > loramac set nwkskey 6CCC73B2681EC60142C5D4933BFE8D34 loramac set nwkskey 6CCC73B2681EC60142C5D4933BFE8D34 > loramac set appskey 07683C44D66D201B557B0DF7EFEF8391 loramac set appskey 07683C44D66D201B557B0DF7EFEF8391 > loramac set rx2_dr 3 loramac set rx2_dr 3 > loramac set dr 3 loramac set dr 3 > loramac join abp loramac join abp Join procedure succeeded! > loramac tx "This is RIOT" cnf 123 loramac tx "This is RIOT" cnf 123 Received ACK from network Message sent with success > loramac tx "This is RIOT" uncnf 42 loramac tx "This is RIOT" uncnf 42 Message sent with success > loramac get ul_cnt loramac get ul_cnt Uplink Counter: 4 > reboot reboot main(): This is RIOT! (Version: 2020.04-devel-2-gb77da-pr_loramac_tests) All up, running the shell now > loramac set ul_cnt 4 loramac set ul_cnt 4 > loramac set deveui 00D23F63A8D87782 loramac set deveui 00D23F63A8D87782 > loramac set appeui 70B3D57ED00204EC loramac set appeui 70B3D57ED00204EC > loramac set devaddr 2601107E loramac set devaddr 2601107E > loramac set nwkskey 6CCC73B2681EC60142C5D4933BFE8D34 loramac set nwkskey 6CCC73B2681EC60142C5D4933BFE8D34 > loramac set appskey 07683C44D66D201B557B0DF7EFEF8391 loramac set appskey 07683C44D66D201B557B0DF7EFEF8391 > loramac set rx2_dr 3 loramac set rx2_dr 3 > loramac set dr 5 loramac set dr 5 > loramac join abp loramac join abp Join procedure succeeded! > loramac tx "This is RIOT" cnf 123 loramac tx "This is RIOT" cnf 123 Received ACK from network Message sent with success > loramac tx "This is RIOT" uncnf 42 loramac tx "This is RIOT" uncnf 42 Message sent with success > loramac get ul_cnt loramac get ul_cnt Uplink Counter: 6 > reboot reboot main(): This is RIOT! (Version: 2020.04-devel-2-gb77da-pr_loramac_tests) All up, running the shell now > loramac set ul_cnt 6 loramac set ul_cnt 6 > TEST PASSED ``` ![image](https://user-images.githubusercontent.com/23060007/72726215-1315ac80-3b88-11ea-81ec-dd6172ae3aea.png)
11-lorawan Task 4 Passes ``` START > loramac help loramac help Usage: loramac > loramac erase loramac erase > reboot reboot main(): This is RIOT! (Version: 2020.04-devel-2-gb77da-pr_loramac_tests) All up, running the shell now > loramac get deveui loramac get deveui DEVEUI: 0000000000000000 > loramac get appeui loramac get appeui APPEUI: 0000000000000000 > loramac get appkey loramac get appkey APPKEY: 00000000000000000000000000000000 > loramac get devaddr loramac get devaddr DEVADDR: 00000000 > loramac get nwkskey loramac get nwkskey NWKSKEY: 00000000000000000000000000000000 > loramac get appskey loramac get appskey APPSKEY: 00000000000000000000000000000000 > loramac set deveui 00D23F63A8D87782 loramac set deveui 00D23F63A8D87782 > loramac set appeui 70B3D57ED00204EC loramac set appeui 70B3D57ED00204EC > loramac set appkey 0A3E1510AEB8DB583B10DCA691522409 loramac set appkey 0A3E1510AEB8DB583B10DCA691522409 > loramac save loramac save > reboot reboot main(): This is RIOT! (Version: 2020.04-devel-2-gb77da-pr_loramac_tests) All up, running the shell now >loramac get deveui loramac get deveui DEVEUI: 00D23F63A8D87782 > loramac get appeui loramac get appeui APPEUI: 70B3D57ED00204EC > loramac get appkey loramac get appkey APPKEY: 0A3E1510AEB8DB583B10DCA691522409 > loramac erase loramac erase > reboot reboot main(): This is RIOT! (Version: 2020.04-devel-2-gb77da-pr_loramac_tests) All up, running the shell now > loramac set deveui 00D23F63A8D87782 loramac set deveui 00D23F63A8D87782 > loramac set appeui 70B3D57ED00204EC loramac set appeui 70B3D57ED00204EC > loramac set devaddr 2601107E loramac set devaddr 2601107E > loramac set nwkskey 6CCC73B2681EC60142C5D4933BFE8D34 loramac set nwkskey 6CCC73B2681EC60142C5D4933BFE8D34 > loramac set appskey 07683C44D66D201B557B0DF7EFEF8391 loramac set appskey 07683C44D66D201B557B0DF7EFEF8391 > loramac set rx2_dr 3 loramac set rx2_dr 3 > loramac save loramac save > reboot reboot main(): This is RIOT! (Version: 2020.04-devel-2-gb77da-pr_loramac_tests) All up, running the shell now > loramac get devaddr loramac get devaddr DEVADDR: 2601107E > loramac get nwkskey loramac get nwkskey NWKSKEY: 6CCC73B2681EC60142C5D4933BFE8D34 > loramac get appskey loramac get appskey APPSKEY: 07683C44D66D201B557B0DF7EFEF8391 > TEST PASSED ```
leandrolanzieri commented 4 years ago
10-icmpv6-error Task 04 - Destination unreachable - address unreachable (neighbor cache miss): PASS ``` >>> srp1(Ether() / IPv6(src="beef::1", dst="affe::1") / UDP(dport=48879) , iface="tapbr0") Begin emission: Finished sending 1 packets. ...* Received 4 packets, got 1 answers, remaining 0 packets >>>>>>>> ```
fjmolinas commented 4 years ago
8-interop Task 3 Passes in RC1 - RIOT iotlab-m3 ``` 2020-01-20 13:48:00,144 # udp server start 3000 2020-01-20 13:48:00,146 # Success: started UDP server on port 3000 > udp send fe80::0212:4b00:0413:3168 3000 "Ping! Contiki" 2020-01-20 13:48:09,920 # udp send fe80::0212:4b00:0413:3168 3000 "Ping! Contiki" 2020-01-20 13:48:09,920 # Success: sent 13 byte(s) to [fe80::0212:4b00:0413:3168]:3000 > udp send fe80::0212:4b00:0413:3168 3000 "Ping! Contiki" 2020-01-20 13:48:22,766 # udp send fe80::0212:4b00:0413:3168 3000 "Ping! Contiki" 2020-01-20 13:48:22,767 # Success: sent 13 byte(s) to [fe80::0212:4b00:0413:3168]:3000 2020-01-20 13:48:22,783 # PKTDUMP: data received: 2020-01-20 13:48:22,784 # ~~ SNIP 0 - size: 13 byte, type: NETTYPE_UNDEF (0) 2020-01-20 13:48:22,785 # 00000000 50 69 6E 67 21 20 43 6F 6E 74 69 6B 69 2020-01-20 13:48:22,786 # ~~ SNIP 1 - size: 8 byte, type: NETTYPE_UDP (4) 2020-01-20 13:48:22,787 # src-port: 3000 dst-port: 3000 2020-01-20 13:48:22,787 # length: 21 cksum: 0xb40f 2020-01-20 13:48:22,789 # ~~ SNIP 2 - size: 40 byte, type: NETTYPE_IPV6 (2) 2020-01-20 13:48:22,790 # traffic class: 0x00 (ECN: 0x0, DSCP: 0x00) 2020-01-20 13:48:22,798 # flow label: 0x00000 2020-01-20 13:48:22,799 # length: 21 next header: 17 hop limit: 64 2020-01-20 13:48:22,799 # source address: fe80::212:4b00:413:3168 2020-01-20 13:48:22,800 # destination address: fe80::348f:fa65:106b:1115 2020-01-20 13:48:22,801 # ~~ SNIP 3 - size: 18 byte, type: NETTYPE_NETIF (-1) 2020-01-20 13:48:22,801 # if_pid: 7 rssi: -44 lqi: 255 2020-01-20 13:48:22,801 # flags: BROADCAST 2020-01-20 13:48:22,801 # src_l2addr: 00:12:4B:00:04:13:31:68 2020-01-20 13:48:22,802 # dst_l2addr: FF:FF 2020-01-20 13:48:22,803 # ~~ PKT - 4 snips, total size: 79 byte ``` - Contiki cc2538dk ``` Contiki-3.x-3345-g32b5b17f6 TI SmartRF06 + cc2538EM CC2538: ID: 0xb964, rev.: PG2.0, Flash: 512 KiB, SRAM: 32 KiB, AES/SHA: 1, ECC/RSA: 1 System clock: 16000000 Hz I/O clock: 16000000 Hz Reset cause: External reset Net: sicslowpan MAC: CSMA RDC: nullrdc Rime configured with address 00:12:4b:00:04:13:31:68 Starting UDP echo server Listen port: 3000, TTL=64 13 bytes from [fe80::348f:fa65:106b:1115]:3000 13 bytes from [fe80::348f:fa65:106b:1115]:3000 ```
fjmolinas commented 4 years ago
8-tests Task 1 Passes in RC1 `BUILD_IN_DOCKER=1 time dist/tools/compile_and_test_for_board/compile_and_test_for_board.py . native --with-test-only` ``` Failures during test: - [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed) - [tests/gnrc_ipv6_ext_frag](tests/gnrc_ipv6_ext_frag/test.failed) - [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed) - [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed) - [tests/gnrc_tcp](tests/gnrc_tcp/test.failed) - [tests/lwip](tests/lwip/test.failed) - [tests/netstats_l2](tests/netstats_l2/test.failed) ``` Re-ran tests requiring setup: - `[tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)` ``` sudo PORT=tap0 make -C tests/gnrc_rpl_srh/ test make: Entering directory '/home/francisco/workspace/RIOT/tests/gnrc_rpl_srh' No protocol specified Unable to init server: Could not connect: Connection refused No protocol specified Unable to init server: Could not connect: Connection refused (01-run.py:15854): Gdk-CRITICAL **: 14:37:59.877: gdk_cursor_new_for_display: assertion 'GDK_IS_DISPLAY (display)' failed ..............SUCCESS make: Leaving directory '/home/francisco/workspace/RIOT/tests/gnrc_rpl_srh' ``` - `[tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)` ``` sudo PORT=tap0 make -C tests/gnrc_sock_dns/ test make: Entering directory '/home/francisco/workspace/RIOT/tests/gnrc_sock_dns' No protocol specified Unable to init server: Could not connect: Connection refused No protocol specified Unable to init server: Could not connect: Connection refused (01-run.py:16062): Gdk-CRITICAL **: 14:39:27.971: gdk_cursor_new_for_display: assertion 'GDK_IS_DISPLAY (display)' failed ..............SUCCESS make: Leaving directory '/home/francisco/workspace/RIOT/tests/gnrc_sock_dns' ``` - `[tests/gnrc_tcp](tests/gnrc_tcp/test.failed)` ``` (05-garbage-pkts.py:16413): Gdk-CRITICAL **: 14:41:08.358: gdk_cursor_new_for_display: assertion 'GDK_IS_DISPLAY (display)' failed - test_short_payload SUCCESS - test_short_header SUCCESS - test_send_ack_instead_of_syn SUCCESS - test_option_parsing_term SUCCESS 05-garbage-pkts.py: success 04-receive_data.py: success 02-conn_lifecycle_as_server.py: success 01-conn_lifecycle_as_client.py: success make: Leaving directory '/home/francisco/workspace/RIOT/tests/gnrc_tcp' ``` - `[tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)` ``` sudo PORT=tap0 make -C tests/gnrc_ipv6_ext test make: Entering directory '/home/francisco/workspace/RIOT/tests/gnrc_ipv6_ext' No protocol specified Unable to init server: Could not connect: Connection refused No protocol specified Unable to init server: Could not connect: Connection refused (01-run.py:15470): Gdk-CRITICAL **: 14:35:47.163: gdk_cursor_new_for_display: assertion 'GDK_IS_DISPLAY (display)' failed ...................SUCCESS make: Leaving directory '/home/francisco/workspace/RIOT/tests/gnrc_ipv6_ext' ``` - `[tests/gnrc_ipv6_ext_frag](tests/gnrc_ipv6_ext_frag/test.failed)` ``` sudo PORT=tap0 make -C tests/gnrc_ipv6_ext_frag test make: Entering directory '/home/francisco/workspace/RIOT/tests/gnrc_ipv6_ext_frag' No protocol specified Unable to init server: Could not connect: Connection refused No protocol specified Unable to init server: Could not connect: Connection refused (01-run.py:15643): Gdk-CRITICAL **: 14:36:39.678: gdk_cursor_new_for_display: assertion 'GDK_IS_DISPLAY (display)' failed ...................SUCCESS make: Leaving directory '/home/francisco/workspace/RIOT/tests/gnrc_ipv6_ext_frag' ``` - `- [tests/lwip](tests/lwip/test.failed)` ``` sudo PORT=tap0 BOARD=native make -C tests/lwip test make: Entering directory '/home/francisco/workspace/RIOT/tests/lwip' Testing for (, ): .... make: Leaving directory '/home/francisco/workspace/RIOT/tests/lwip' ``` - `- [tests/netstats_l2](tests/lwip/test.failed)` ``` /home/francisco/workspace/RIOT/tests/netstats_l2/bin/native/tests_netstats_l2.elf tap0 RIOT native interrupts/signals initialized. LED_RED_OFF LED_GREEN_ON RIOT native board initialized. RIOT native hardware initialization complete. main(): This is RIOT! (Version: 2020.04-devel-HEAD) Welcome to RIOT! > r READY > s s START > ifconfig ifconfig Iface 3 HWaddr: 9E:8C:0B:5A:52:43 L2-PDU:1500 Source address length: 6 Statistics for Layer 2 RX packets 4 bytes 600 TX packets 0 (Multicast: 0) bytes 0 TX succeeded 0 errors 0 > make: Leaving directory '/home/francisco/workspace/RIOT/tests/netstats_l2' ```
leandrolanzieri commented 4 years ago
10-icmpv6-error Task 05 - Destination unreachable - port unreachable: PASS ``` >>> srp1(Ether(dst="8E:A7:F9:79:80:F7") / IPv6(src="fe80::548d:20ff:fe6c:2a8", dst="fe80::8ca7:f9ff:fe79:80f7") / UDP(dport=48879) , iface="tapbr0") Begin emission: Finished sending 1 packets. * Received 1 packets, got 1 answers, remaining 0 packets >>>>>>>>> ```
10-icmpv6-error Task 07 - Packet too big: PASS ``` >>> data = Raw(RandString(size=1452)) >>> srp1(Ether() / IPv6(src="beef::1", dst="affe::1") / UDP(dport=48879) / data , iface="tapbr0") Begin emission: WARNING: No route found for IPv6 destination affe::1 (no default route?) WARNING: No route found for IPv6 destination affe::1 (no default route?) Finished sending 1 packets. WARNING: wrong value: DNS.qdcount=22853 WARNING: wrong value: DNS.ancount=29553 WARNING: more wrong value: DNS.nscount=13636 * Received 1 packets, got 1 answers, remaining 0 packets >>>>>> ```
leandrolanzieri commented 4 years ago
10-icmpv6-error Task 08 - Time exceeded - hop limit exceeded in transit: PASS ``` >>> srp1(Ether() / IPv6(src="beef::1", dst="affe::1", hlim=1) / UDP(dport=48879) , iface="tapbr0") Begin emission: WARNING: No route found for IPv6 destination affe::1 (no default route?) WARNING: No route found for IPv6 destination affe::1 (no default route?) Finished sending 1 packets. * Received 1 packets, got 1 answers, remaining 0 packets >>>>> ```
10-icmpv6-error Task 09 - Parameter problem - erroneous header field encountered: PASS ``` >>> DST_ADDR="fe80::78a1:dfff:fe75:f937" >>> SRC_ADDR="fe80::78a1:dfff:fe75:f936" >>> DST_HW_ADDR="7A:A1:DF:75:F9:37" >>> srp1(Ether(dst=DST_HW_ADDR) / IPv6(src=SRC_ADDR, dst=DST_ADDR, plen=20) / UDP(dport=48879) , iface="tapbr0") Begin emission: Finished sending 1 packets. * Received 1 packets, got 1 answers, remaining 0 packets >>>>>> ```
leandrolanzieri commented 4 years ago
10-icmpv6-error Task 10 - IPv6-in-IPv6 encapsulation: PASS ``` sudo python3 riot-release-10-10.py tapbr0 fe80::78a1:dfff:fe75:f937 fe80::78a1:dfff:fe75:f936 7A:A1:DF:75:F9:37 # No errors ```

Wireshark packet dissections

fjmolinas commented 4 years ago

All tests but tests/gnrc_tcp are ok, I'll take a closer look later.

2-tests Task 3 - issues with `tests/gnrc_tcp` Ran first without `sudo` or other required setups. `pkg_fatfs_vfs` is expected to fail and `riph_timer_short_relative_set` because of hw limitations so also expected to fail. ``` Failures during test: - [examples/suit_update](samr21-xpro/examples/suit_update/test.failed) - [tests/gnrc_ipv6_ext](samr21-xpro/tests/gnrc_ipv6_ext/test.failed) - [tests/gnrc_ipv6_ext_frag](samr21-xpro/tests/gnrc_ipv6_ext_frag/test.failed) - [tests/gnrc_rpl_srh](samr21-xpro/tests/gnrc_rpl_srh/test.failed) - [tests/gnrc_sock_dns](samr21-xpro/tests/gnrc_sock_dns/test.failed) - [tests/gnrc_tcp](samr21-xpro/tests/gnrc_tcp/test.failed) - [tests/periph_timer_short_relative_set](samr21-xpro/tests/periph_timer_short_relative_set/test.failed) - [tests/pkg_fatfs_vfs](samr21-xpro/tests/pkg_fatfs_vfs/test.failed) ``` - `[tests/gnrc_ipv6_ext](samr21-xpro/tests/gnrc_ipv6_ext/test.failed)` ``` sudo "PATH=$PATH" BOARD=samr21-xpro make -C tests/gnrc_ipv6_ext test --no-print-directory make[1]: Nothing to be done for 'all'. No protocol specified Unable to init server: Could not connect: Connection refused No protocol specified Unable to init server: Could not connect: Connection refused (01-run.py:3668): Gdk-CRITICAL **: 18:04:29.393: gdk_cursor_new_for_display: assertion 'GDK_IS_DISPLAY (display)' failed ...................SUCCESS ``` - `[tests/gnrc_ipv6_ext_frag](samr21-xpro/tests/gnrc_ipv6_ext_frag/test.failed)` ``` sudo "PATH=$PATH" BOARD=samr21-xpro make -C tests/gnrc_ipv6_ext_frag test --no-print-directory make[1]: Nothing to be done for 'all'. No protocol specified Unable to init server: Could not connect: Connection refused No protocol specified Unable to init server: Could not connect: Connection refused (01-run.py:1902): Gdk-CRITICAL **: 18:11:09.734: gdk_cursor_new_for_display: assertion 'GDK_IS_DISPLAY (display)' failed ................SUCCESS Skipping datagram reception tests due to ethos bug. ``` - `[tests/gnrc_rpl_srh](samr21-xpro/tests/gnrc_rpl_srh/test.failed)` ``` sudo "PATH=$PATH" BOARD=samr21-xpro make -C tests/gnrc_rpl_srh/ test --no-print-directory make[1]: Nothing to be done for 'all'. No protocol specified Unable to init server: Could not connect: Connection refused No protocol specified Unable to init server: Could not connect: Connection refused (01-run.py:16420): Gdk-CRITICAL **: 18:13:40.772: gdk_cursor_new_for_display: assertion 'GDK_IS_DISPLAY (display)' failed ..............SUCCESS ``` - `[tests/gnrc_sock_dns](samr21-xpro/tests/gnrc_sock_dns/test.failed)` ``` sudo "PATH=$PATH" BOARD=samr21-xpro make -C tests/gnrc_sock_dns/ test --no-print-directory make[1]: Nothing to be done for 'all'. No protocol specified Unable to init server: Could not connect: Connection refused No protocol specified Unable to init server: Could not connect: Connection refused (01-run.py:4475): Gdk-CRITICAL **: 18:17:50.203: gdk_cursor_new_for_display: assertion 'GDK_IS_DISPLAY (display)' failed ..............SUCCESS ``` - `[tests/gnrc_tcp](samr21-xpro/tests/gnrc_tcp/test.failed)` ``` ``` - `[examples/suit_update](samr21-xpro/examples/suit_update/test.failed)` ``` suit_coap: started. Starting the shell > ifconfig ifconfig Iface 5 HWaddr: 00:53:CB:6B:A0:79 L2-PDU:1500 MTU:1500 HL:64 RTR RTR_ADV Source address length: 6 Link type: wired inet6 addr: fe80::253:cbff:fe6b:a079 scope: link VAL pinging node... PING fe80::253:cbff:fe6b:a079%riot0(fe80::253:cbff:fe6b:a079%riot0) 56 data bytes --- fe80::253:cbff:fe6b:a079%riot0 ping statistics --- 1 packets transmitted, 1 received, 0% packet loss, time 0ms rtt min/avg/max/mdev = 40.259/40.259/40.259/0.000 ms pinging node succeeded. TEST PASSED ```
fjmolinas commented 4 years ago

On non-native boards I have a timeout on tests/gnrc_tcp

> Timeout in expect script at "child.expect_exact('gnrc_tcp_recv: received ' + str(half_data_len))" (tests/gnrc_tcp/tests/06-receive_data_closed_conn.py:55)
  File "/home/francisco/workspace/RIOT/dist/pythonlibs/testrunner/__init__.py", line 29, in run
    testfunc(child)
  File "/home/francisco/workspace/RIOT/tests/gnrc_tcp/tests/06-receive_data_closed_conn.py", line 55, in testfunc
    child.expect_exact('gnrc_tcp_recv: received ' + str(half_data_len))
  File "/home/francisco/.local/lib/python3.6/site-packages/pexpect/spawnbase.py", line 418, in expect_exact
    return exp.expect_loop(timeout)
  File "/home/francisco/.local/lib/python3.6/site-packages/pexpect/expect.py", line 119, in expect_loop
    return self.timeout(e)
  File "/home/francisco/.local/lib/python3.6/site-packages/pexpect/expect.py", line 82, in timeout
    raise TIMEOUT(msg)

Enabling echo on the test I get:

buffer_init
buffer_get_max_size
> buffer_init: argc=1, argv[0] = buffer_init
> buffer_get_max_size: argc=1, argv[0] = buffer_get_max_size
buffer_get_max_size: returns 2048
ifconfig
> Iface  5  HWaddr: 00:53:CB:6B:A0:79 
gnrc_tcp_tcb_init
gnrc_tcp_open_active AF_INET6 fe80::143f:baff:fe95:3e30%5 56991 0
          L2-PDU:1500 MTU:1500  HL:64  Source address length: 6
          Link type: wired
          inet6 addr: fe80::253:cbff:fe6b:a079  scope: link  VAL
          inet6 group: ff02::1
          inet6 group: ff02::1:ff6b:a079

> gnrc_tcp_tcb_init: argc=1, argv[0] = gnrc_tcp_tcb_init
> gnrc_tcp_open_active: argc=5, argv[0] = gnrc_tcp_open_active, argv[1] = AF_INET6, argv[2] = fe80::143f:baff:fe95:3e30%5, argv[3] = 56991, argv[4] = 0
gnrc_tcp_open_active: returns 0
gnrc_tcp_recv 1000000 5
> gnrc_tcp_recv: argc=3, argv[0] = gnrc_tcp_recv, argv[1] = 1000000, argv[2] = 5
gnrc_tcp_recv: returns 0

Can anyone try to reproduce?

miri64 commented 4 years ago

IIRC this test was far from stable on boards, even when merged. Is that on native or real board?

fjmolinas commented 4 years ago

IIRC this test was far from stable on boards, even when merged. Is that on native or real board?

non-native, works fine on native.

fjmolinas commented 4 years ago

IIRC this test was far from stable on boards, even when merged. Is that on native or real board?

Can we just whitelist native then?