RIOT-OS / Release-Specs

Specification for RIOT releases and corresponding test configurations
4 stars 21 forks source link

conftest: Randomize default PAN_ID #300

Closed MrKevinWeiss closed 8 months ago

MrKevinWeiss commented 8 months ago

Due to some issues with other border routers running we should harden the tests against that by using a random PAN_ID.

See https://github.com/RIOT-OS/Release-Specs/pull/299 for some info (it contains a train of references)

MrKevinWeiss commented 8 months ago
From a locally run test ``` > ifconfig ifconfig Iface 6 HWaddr: 0B:BE Channel: 26 NID: 0x1905 PHY: O-QPSK Long HWaddr: E6:D3:6F:EC:DF:36:0B:BE TX-Power: 0dBm State: IDLE max. Retrans.: 3 CSMA Retries: 4 AUTOACK ACK_REQ CSMA L2-PDU:102 MTU:1280 HL:64 RTR RTR_ADV 6LO IPHC Source address length: 8 Link type: wireless inet6 addr: fe80::e4d3:6fec:df36:bbe scope: link VAL inet6 group: ff02::2 inet6 group: ff02::1 inet6 group: ff02::1:ff36:bbe inet6 group: ff02::1a Statistics for Layer 2 RX packets 1 bytes 43 TX packets 3 (Multicast: 3) bytes 115 TX succeeded 3 errors 0 Statistics for IPv6 RX packets 1 bytes 64 TX packets 3 (Multicast: 3) bytes 178 TX succeeded 3 errors 0 > ifconfig 6 add beef::1/64 ifconfig 6 add beef::1/64 success: added beef::1/64 to interface 6 > ssh -t weoss@saclay.iot-lab.info 'socat - tcp:m3-10.saclay.iot-lab.info:20000' > ifconfig ifconfig Iface 6 HWaddr: 67:C3 Channel: 26 NID: 0x1905 PHY: O-QPSK Long HWaddr: 7A:94:05:FF:25:8D:E7:C3 TX-Power: 0dBm State: IDLE max. Retrans.: 3 CSMA Retries: 4 AUTOACK ACK_REQ CSMA L2-PDU:102 MTU:1280 HL:64 RTR RTR_ADV 6LO IPHC Source address length: 8 Link type: wireless inet6 addr: fe80::7894:5ff:258d:e7c3 scope: link VAL inet6 group: ff02::2 inet6 group: ff02::1 inet6 group: ff02::1:ff8d:e7c3 inet6 group: ff02::1a Statistics for Layer 2 RX packets 6 bytes 230 TX packets 5 (Multicast: 5) bytes 201 TX succeeded 5 errors 0 Statistics for IPv6 RX packets 6 bytes 356 TX packets 5 (Multicast: 5) bytes 306 TX succeeded 5 errors 0 > ifconfig 6 add affe::1/120 ifconfig 6 add affe::1/120 success: added affe::1/120 to interface 6 > nib route add 6 :: fe80::7894:5ff:258d:e7c3 nib route add 6 :: fe80::7894:5ff:258d:e7c3 > nib route add 6 :: fe80::e4d3:6fec:df36:bbe nib route add 6 :: fe80::e4d3:6fec:df36:bbe > ping beef::1 -c 100 -i 300 -s 1024 -W 1000 ping beef::1 -c 100 -i 300 -s 1024 -W 1000 1032 bytes from beef::1: icmp_seq=0 ttl=64 rssi=-46 dBm time=154.346 ms 1032 bytes from beef::1: icmp_seq=1 ttl=64 rssi=-46 dBm time=147.027 ms ```
MrKevinWeiss commented 8 months ago

Needs https://github.com/RIOT-OS/Release-Specs/pull/301 for the CI fix

miri64 commented 8 months ago

Started testrun here https://github.com/RIOT-OS/RIOT/actions/runs/7724069733

MrKevinWeiss commented 8 months ago

wait wait wait. I think dec is cleanest.

MrKevinWeiss commented 8 months ago

Let's see the results

miri64 commented 8 months ago

Should we run it once more completely or due we trust the selected results?

MrKevinWeiss commented 8 months ago

lets do it completely.

miri64 commented 8 months ago

https://github.com/RIOT-OS/RIOT/actions/runs/7725431205

MrKevinWeiss commented 8 months ago

Maybe we should also make a mark for really slow (1 hour stress test) so that we don't timeout the action...

miri64 commented 8 months ago

The interop test between GNRC and lwIP fails. Is there some extra tweeking needed for lwIP :-/?

miri64 commented 8 months ago

From what I see in the code, the PAN ID should be set... I will have a look, once I have some boards or a more stable Internet connection if this is really the case.

miri64 commented 8 months ago

From what I see in the code, the PAN ID should be set...

Nope, the needed default-radio-settings.inc.mk is not included. See https://github.com/RIOT-OS/RIOT/pull/20325.

MrKevinWeiss commented 8 months ago

Thanks for looking after this!