RIOT-OS / Release-Specs

Specification for RIOT releases and corresponding test configurations
4 stars 21 forks source link

Release 2020.04 - RC3 #154

Closed leandrolanzieri closed 4 years ago

leandrolanzieri commented 4 years ago

This issue lists the status of all tests for the Release Candidate 3 of the 2020.04 release.

Specs tested:

leandrolanzieri commented 4 years ago

PRs backported between RC2 and RC3

These PRs were merged into 2020.04-branch after 2020.04-RC2 tag was created

PR Description
#13948 examples/gnrc_border_router: don't ignore ETHOS_BAUDRATE
#13960 gnrc_ipv6_nib: fix NS sending for multiple upstream interfaces
#13963 tests/gnrc_dhcpv6_client: Fix term and increase timeout
leandrolanzieri commented 4 years ago

@miri64 recommended running the following tests to be sure:

leandrolanzieri commented 4 years ago
[07-multi-hop] Task 03: PASS ``` # Check RPL m3-184;rpl 1588002277.576102;m3-184;> rpl 1588002277.576653;m3-184;instance table: [X] 1588002277.577613;m3-184;parent table: [X] [ ] [ ] 1588002277.578452;m3-184; 1588002277.578809;m3-184;instance [0 | Iface: 6 | mop: 2 | ocp: 0 | mhri: 256 | mri 0] 1588002277.579489;m3-184; dodag [abcd::1 | R: 1024 | OP: Router | PIO: on | TR(I=[8,20], k=10, c=0, TC=1s)] 1588002277.580534;m3-184; parent [addr: fe80::b5:f965:106b:1114 | rank: 768] # Ping root node m3-184;ping6 -c 100 -s 50 -i 100 abcd::1 1588002454.350291;m3-184;> ping6 -c 100 -s 50 -i 100 abcd::1 1588002454.390026;m3-184;58 bytes from abcd::1: icmp_seq=0 ttl=62 rssi=-29 dBm time=38.537 ms 1588002454.489976;m3-184;58 bytes from abcd::1: icmp_seq=1 ttl=62 rssi=-29 dBm time=37.899 ms [...] 1588002464.296442;m3-184;58 bytes from abcd::1: icmp_seq=99 ttl=62 rssi=-29 dBm time=41.726 ms 1588002464.296773;m3-184; 1588002464.297117;m3-184;--- abcd::1 PING statistics --- 1588002464.298729;m3-184;100 packets transmitted, 100 packets received, 0% packet loss 1588002464.299002;m3-184;round-trip min/avg/max = 36.937/41.809/47.493 ms ```
[07-multi-hop] Task 04: PASS ``` # Check RPL m3-184;rpl 1588002277.576102;m3-184;> rpl 1588002277.576653;m3-184;instance table: [X] 1588002277.577613;m3-184;parent table: [X] [ ] [ ] 1588002277.578452;m3-184; 1588002277.578809;m3-184;instance [0 | Iface: 6 | mop: 2 | ocp: 0 | mhri: 256 | mri 0] 1588002277.579489;m3-184; dodag [abcd::1 | R: 1024 | OP: Router | PIO: on | TR(I=[8,20], k=10, c=0, TC=1s)] 1588002277.580534;m3-184; parent [addr: fe80::b5:f965:106b:1114 | rank: 768] # UDP from Root to node m3-181;udp send abcd::b4:fb65:106b:1114 4321 50 100 100000 1588002715.021482;m3-181;> udp send abcd::b4:fb65:106b:1114 4321 50 100 100000 1588002715.023186;m3-181;Success: send 50 byte to [abcd::b4:fb65:106b:1114]:4321 1588002715.043078;m3-184;> Packets received: 1 1588002715.125334;m3-181;Success: send 50 byte to [abcd::b4:fb65:106b:1114]:4321 1588002715.142698;m3-184;Packets received: 2 [...] 1588002725.018743;m3-181;Success: send 50 byte to [abcd::b4:fb65:106b:1114]:4321 1588002725.038092;m3-184;Packets received: 99 1588002725.121644;m3-181;Success: send 50 byte to [abcd::b4:fb65:106b:1114]:4321 1588002725.141101;m3-184;Packets received: 100 # UDP from node to Root m3-184;udp send abcd::1 1234 50 100 100000 1588002759.287980;m3-184;udp send abcd::1 1234 50 100 100000 1588002759.289514;m3-184;Success: send 50 byte to [abcd::1]:1234 1588002759.309534;m3-181;> Packets received: 1 1588002759.390749;m3-184;Success: send 50 byte to [abcd::1]:1234 1588002759.412927;m3-181;Packets received: 2 [...] 1588002769.251984;m3-184;Success: send 50 byte to [abcd::1]:1234 1588002769.270221;m3-181;Packets received: 99 1588002769.353932;m3-184;Success: send 50 byte to [abcd::1]:1234 1588002769.372178;m3-181;Packets received: 100 # Check pktbuf m3-181;pktbuf 1588002973.716964;m3-181;pktbuf 1588002973.717886;m3-181;packet buffer: first byte: 0x2000221c, last byte: 0x2000421c (size: 8192) 1588002973.718451;m3-181; position of last byte used: 472 1588002973.718853;m3-181;~ unused: 0x2000221c (next: (nil), size: 8192) ~ m3-184;pktbuf 1588002981.786506;m3-184;> pktbuf 1588002981.786834;m3-184;packet buffer: first byte: 0x2000221c, last byte: 0x2000421c (size: 8192) 1588002981.788142;m3-184; position of last byte used: 400 1588002981.788575;m3-184;~ unused: 0x2000221c (next: (nil), size: 8192) ~ ```
miri64 commented 4 years ago

@miri64 recommended running the following tests to be sure:

* 03-single-hop-ipv6-icmp: Tasks 03 and 04

* 07-multi-hop: Tasks 03 and 04

I also think the border router tests should be re-done with regards to https://github.com/RIOT-OS/RIOT/pull/13960. Sorry, only was thinking of them now.

leandrolanzieri commented 4 years ago
[03-single-hop] Task 04: PASS ``` main(): This is RIOT! (Version: 2020.07-devel-34-gb2a9e-HEAD) > ifconfig ifconfig Iface 5 HWaddr: 86:4E:F9:C7:8F:5B L2-PDU:1500 MTU:1500 HL:64 RTR RTR_ADV Source address length: 6 Link type: wired inet6 addr: fe80::844e:f9ff:fec7:8f5b scope: link VAL inet6 group: ff02::2 inet6 group: ff02::1 inet6 group: ff02::1:ffc7:8f5b Statistics for Layer 2 RX packets 1254951 bytes 1899338457 TX packets 1252015 (Multicast: 78) bytes 1895091090 TX succeeded 1252015 errors 0 Statistics for IPv6 RX packets 1252293 bytes 1877782143 TX packets 1252015 (Multicast: 78) bytes 1877562880 TX succeeded 1252015 errors 0 > pktbuf pktbuf packet buffer: first byte: 0x56607c20, last byte: 0x56609c20 (size: 8192) position of last byte used: 7832 ~ unused: 0x56607c20 (next: (nil), size: 8192) ~ ```
jia200x commented 4 years ago
[03-single-hop] Task 03: PASS ``` --- fe80::804e:b4ff:fe15:3164 PING statistics --- 3600 packets transmitted, 3600 packets received, 0% packet loss round-trip min/avg/max = 0.218/0.904/1.687 ms ```
jia200x commented 4 years ago
[08-interop] Task 05 pass ``` 77 299.285872238 2001:db8::4cc7:1122:4018:6578 2001:db8:1::1 ICMPv6 66 Echo (ping) request id=0xb5d2, seq=0, hop limit=63 (reply in 78) 78 299.285937765 2001:db8:1::1 2001:db8::4cc7:1122:4018:6578 ICMPv6 66 Echo (ping) reply id=0xb5d2, seq=0, hop limit=64 (request in 77) 79 300.289877680 2001:db8::4cc7:1122:4018:6578 2001:db8:1::1 ICMPv6 66 Echo (ping) request id=0xb5d2, seq=1, hop limit=63 (reply in 80) 80 300.289916921 2001:db8:1::1 2001:db8::4cc7:1122:4018:6578 ICMPv6 66 Echo (ping) reply id=0xb5d2, seq=1, hop limit=64 (request in 79) 81 301.295948281 2001:db8::4cc7:1122:4018:6578 2001:db8:1::1 ICMPv6 66 Echo (ping) request id=0xb5d2, seq=2, hop limit=63 (reply in 82) 82 301.295975347 2001:db8:1::1 2001:db8::4cc7:1122:4018:6578 ICMPv6 66 Echo (ping) reply id=0xb5d2, seq=2, hop limit=64 (request in 81) ```
jia200x commented 4 years ago
[08-interop] Task 04: PASS ``` Capturing on 'lowpan0' 1 0.000000000 2002:8d16:1b8e:28a1:4cc7:1122:4018:6578 ? 2002:8d16:1b8e:28a::1 ICMPv6 68 Echo (ping) request id=0x2497, seq=0, hop limit=255 2 0.000126615 2002:8d16:1b8e:28a::1 ? 2002:8d16:1b8e:28a1:4cc7:1122:4018:6578 ICMPv6 68 Echo (ping) reply id=0x2497, seq=0, hop limit=64 (request in 1) 3 0.671736250 fe80::4cc7:1122:4018:6578 ? ff02::2 ICMPv6 80 Router Solicitation from 4e:c7:11:22:40:18:65:78 4 0.672407240 fe80::243b:e40c:8ceb:f013 ? fe80::4cc7:1122:4018:6578 ICMPv6 144 Router Advertisement from 26:3b:e4:0c:8c:eb:f0:13 5 1.005421510 2002:8d16:1b8e:28a1:4cc7:1122:4018:6578 ? 2002:8d16:1b8e:28a::1 ICMPv6 68 Echo (ping) request id=0x2497, seq=1, hop limit=255 6 1.005504427 2002:8d16:1b8e:28a::1 ? 2002:8d16:1b8e:28a1:4cc7:1122:4018:6578 ICMPv6 68 Echo (ping) reply id=0x2497, seq=1, hop limit=64 (request in 5) 7 2.010929479 2002:8d16:1b8e:28a1:4cc7:1122:4018:6578 ? 2002:8d16:1b8e:28a::1 ICMPv6 68 Echo (ping) request id=0x2497, seq=2, hop limit=255 8 2.011045572 2002:8d16:1b8e:28a::1 ? 2002:8d16:1b8e:28a1:4cc7:1122:4018:6578 ICMPv6 68 Echo (ping) reply id=0x2497, seq=2, hop limit=64 (request in 7) ```
jia200x commented 4 years ago
[08-interop] Task 06: PASS Node: ``` 2020-04-28 13:42:17,871 # udp send 2001:db8:1::1 8080 10 2020-04-28 13:42:17,877 # Success: send 10 byte to [2001:db8:1::1]:8080 ``` Host: ``` python recv.py b'\x08\x08\x08\x08\x08\x08\x08\x08\x08\x08' ```
[08-interop] Task 07: PASS Node: ``` > udp send 2001:db8:1::1 8080 300 2020-04-28 13:42:10,232 # udp send 2001:db8:1::1 8080 300 2020-04-28 13:42:10,258 # Success: send 300 byte to [2001:db8:1::1]:8080 ``` Host: ``` python recv.py b'\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07\x07' ```
leandrolanzieri commented 4 years ago

Nice! Thanks @jia200x !

leandrolanzieri commented 4 years ago

Closing now that the 2020.04 release is out.