RIOT-OS / Release-Specs

Specification for RIOT releases and corresponding test configurations
4 stars 21 forks source link

Release 2019.07 - RC1 #128

Closed MrKevinWeiss closed 5 years ago

MrKevinWeiss commented 5 years ago

This issue lists the status of all tests for the Release Candidate 1 of the 2019.07 release.

Specs tested:

MrKevinWeiss commented 5 years ago
10-icmpv6-error Task 6 ``` srp1(Ether(dst="92:5C:55:A8:00:CA") / IPv6(src="fe80::743c:50ff:fe8b:ea46", dst="fe80::905c:55ff:fea8:ca") / UDP(dport=48879) / pkt, iface="tapbr0") Begin emission: Finished sending 1 packets. WARNING: wrong value: DNS.qdcount=12336 WARNING: wrong value: DNS.ancount=12336 WARNING: more wrong value: DNS.nscount=12336 * Received 1 packets, got 1 answers, remaining 0 packets >>>>>>
MrKevinWeiss commented 5 years ago
10-icmpv6-error Task 4 (@miri64) ``` >>> srp1(Ether(dst="96:A8:5A:D6:8A:C1")/IPv6(src="beef::1", dst="affe::1")/UDP(dport=48879)/"", iface="tapbr0", timeout=10) Begin emission: Finished sending 1 packets. ...* Received 4 packets, got 1 answers, remaining 0 packets >>>>>
miri64 commented 5 years ago

(forgot the large payload, so it is a rerun of 5, but :woman_shrugging: you managed to run it yourself :-))

MrKevinWeiss commented 5 years ago
10-icmpv6-error Task 7 (@miri64 ) ``` >>> srp1(Ether(dst="96:A8:5A:D6:8A:C1")/IPv6(src="beef::1", dst="affe::1")/UDP(dport=48879)/("X" * 1452), iface="tapbr0", timeout=1) Begin emission: Finished sending 1 packets. . Received 1 packets, got 0 answers, remaining 1 packets >>> srp1(Ether(dst="96:A8:5A:D6:8A:C1")/IPv6(src="beef::1", dst="affe::1")/UDP(dport=48879)/("X" * 1452), iface="tapbr0", timeout=1) Begin emission: Finished sending 1 packets. WARNING: wrong value: DNS.qdcount=22616 WARNING: wrong value: DNS.ancount=22616 WARNING: more wrong value: DNS.nscount=22616 * Received 1 packets, got 1 answers, remaining 0 packets >>>>>>
fjmolinas commented 5 years ago
11-lorawan Task 1 Passes ``` 2019-07-18 10:48:46,909 - INFO # main(): This is RIOT! (Version: 2019.10-devel-6-g9bb81-2019.07-branch) 2019-07-18 10:48:46,910 - INFO # LoRaWAN Class A low-power application 2019-07-18 10:48:46,910 - INFO # ===================================== 2019-07-18 10:48:46,910 - INFO # Starting join procedure 2019-07-18 10:48:51,286 - INFO # Join procedure succeeded 2019-07-18 10:48:51,288 - INFO # Sending: This is RIOT! 2019-07-18 10:48:52,403 - INFO # Cannot send message 'This is RIOT!', ret code: 6 2019-07-18 10:49:12,405 - INFO # Sending: This is RIOT! 2019-07-18 10:49:13,521 - INFO # Cannot send message 'This is RIOT!', ret code: 6 2019-07-18 10:49:33,522 - INFO # Sending: This is RIOT! 2019-07-18 10:49:34,638 - INFO # Cannot send message 'This is RIOT!', ret code: 6 2019-07-18 10:49:54,639 - INFO # Sending: This is RIOT! 2019-07-18 10:49:55,755 - INFO # Cannot send message 'This is RIOT!', ret code: 6 ``` ![image](https://user-images.githubusercontent.com/23060007/61443503-ecad5500-a949-11e9-98a4-65da89d1fbd5.png)
fjmolinas commented 5 years ago
11-lorawan Task 3 Passes - DR0: ``` 2019-07-18 10:59:44,627 - INFO # main(): This is RIOT! (Version: 2019.10-devel-6-g9bb81-2019.07-branch) 2019-07-18 10:59:44,629 - INFO # All up, running the shell now loramac set deveui 00EA17067F596D18 2019-07-18 10:59:52,791 - INFO # loramac set deveui 00EA17067F596D18 loramac set appeui 70B3D57ED000B02F 2019-07-18 10:59:57,159 - INFO # loramac set appeui 70B3D57ED000B02F : loramac set devaddr 26011C28 2019-07-18 11:00:01,630 - INFO # loramac set devaddr 26011C28 : loramac set appskey E38E70FD74D768BE36EA753D96D5030C 2019-07-18 11:00:03,911 - INFO # loramac set appskey E38E70FD74D768BE36EA753D96D5030C loramac set nwkskey C89D06AB37D58373FA50B69B7D288B1C 2019-07-18 11:00:07,200 - INFO # loramac set nwkskey C89D06AB37D58373FA50B69B7D288B1C > loramac set dr 0 2019-07-18 11:00:12,867 - INFO # loramac set dr 0 loramac set rx2_dr 3 2019-07-18 11:00:30,661 - INFO # loramac set rx2_dr 3 : loramac tx "lrwan task03" cnf 123 2019-07-18 11:00:45,767 - INFO # loramac tx "rwan task03" cnf 123 loramac 2019-07-18 11:00:49,433 - INFO # Received ACK from network 2019-07-18 11:00:49,435 - INFO # Message sent with success loramac tx "rwan task03" uncnf 42 2019-07-18 11:01:05,239 - INFO # loramac tx "rwan task03" uncnf 42 2019-07-18 11:01:05,245 - INFO # Cannot send: dutycycle restriction > loramac tx "rwan task03" uncnf 42 2019-07-18 11:01:18,991 - INFO # loramac tx "rwan task03" uncnf 42 2019-07-18 11:01:18,995 - INFO # Cannot send: dutycycle restriction > loramac tx "rwan task03" uncnf 42 2019-07-18 11:01:36,935 - INFO # loramac tx "rwan task03" uncnf 42 2019-07-18 11:01:36,939 - INFO # Cannot send: dutycycle restriction > loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:02,863 - INFO # loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:02,868 - INFO # Cannot send: dutycycle restriction > loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:32,535 - INFO # loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:32,540 - INFO # Cannot send: dutycycle restriction > loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:39,375 - INFO # loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:39,380 - INFO # Cannot send: dutycycle restriction > loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:47,216 - INFO # loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:47,221 - INFO # Cannot send: dutycycle restriction > loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:49,439 - INFO # loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:49,444 - INFO # Cannot send: dutycycle restriction > loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:50,782 - INFO # loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:50,788 - INFO # Cannot send: dutycycle restriction > loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:51,615 - INFO # loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:51,620 - INFO # Cannot send: dutycycle restriction > loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:52,383 - INFO # loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:52,388 - INFO # Cannot send: dutycycle restriction > loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:53,062 - INFO # loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:53,067 - INFO # Cannot send: dutycycle restriction > loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:53,695 - INFO # loramac tx "rwan task03" uncnf 42 2019-07-18 11:02:53,700 - INFO # Cannot send: dutycycle restriction > loramac tx "rwan task03" uncnf 42 2019-07-18 11:04:33,657 - INFO # loramac tx "rwan task03" uncnf 42 2019-07-18 11:04:37,712 - INFO # Message sent with success ``` - DR3: ``` 2019-07-18 11:06:13,447 - INFO # main(): This is RIOT! (Version: 2019.10-devel-6-g9bb81-2019.07-branch) 2019-07-18 11:06:13,449 - INFO # All up, running the shell now > loramac set deveui 00EA17067F596D18 2019-07-18 11:06:19,728 - INFO # loramac set deveui 00EA17067F596D18 > loramac set appeui 70B3D57ED000B02F 2019-07-18 11:06:22,912 - INFO # loramac set appeui 70B3D57ED000B02F > loramac set devaddr 26011C28 2019-07-18 11:06:24,809 - INFO # loramac set devaddr 26011C28 > loramac set appskey E38E70FD74D768BE36EA753D96D5030C 2019-07-18 11:06:27,332 - INFO # loramac set appskey E38E70FD74D768BE36EA753D96D5030C > loramac set nwkskey C89D06AB37D58373FA50B69B7D288B1C 2019-07-18 11:06:29,569 - INFO # loramac set nwkskey C89D06AB37D58373FA50B69B7D288B1C > loramac set rx2_dr 3 2019-07-18 11:06:31,688 - INFO # loramac set rx2_dr 3 > loramac set dr 3 2019-07-18 11:06:36,535 - INFO # loramac set dr 3 > loramac tx "rwan task03" cnf 123 2019-07-18 11:06:41,002 - INFO # loramac tx "rwan task03" cnf 123 2019-07-18 11:06:43,392 - INFO # Received ACK from network 2019-07-18 11:06:43,394 - INFO # Message sent with success > loramac tx "rwan task03" uncnf 42 2019-07-18 11:06:48,481 - INFO # loramac tx "rwan task03" uncnf 42 2019-07-18 11:06:48,486 - INFO # Cannot send: dutycycle restriction > loramac tx "rwan task03" uncnf 42 2019-07-18 11:06:52,754 - INFO # loramac tx "rwan task03" uncnf 42 2019-07-18 11:06:52,758 - INFO # Cannot send: dutycycle restriction > loramac tx "rwan task03" uncnf 42 2019-07-18 11:08:08,407 - INFO # loramac tx "rwan task03" uncnf 42 2019-07-18 11:08:11,457 - INFO # Message sent with success > ``` - DR5: ``` 2019-07-18 11:08:25,726 - INFO # main(): This is RIOT! (Version: 2019.10-devel-6-g9bb81-2019.07-branch) 2019-07-18 11:08:25,729 - INFO # All up, running the shell now > loramac set deveui 00EA17067F596D18 2019-07-18 11:08:28,642 - INFO # loramac set deveui 00EA17067F596D18 > loramac set appeui 70B3D57ED000B02F 2019-07-18 11:08:31,362 - INFO # loramac set appeui 70B3D57ED000B02F > loramac set devaddr 26011C28 2019-07-18 11:08:32,962 - INFO # loramac set devaddr 26011C28 > loramac set appskey E38E70FD74D768BE36EA753D96D5030C 2019-07-18 11:08:35,874 - INFO # loramac set appskey E38E70FD74D768BE36EA753D96D5030C > loramac set nwkskey C89D06AB37D58373FA50B69B7D288B1C 2019-07-18 11:08:37,996 - INFO # loramac set nwkskey C89D06AB37D58373FA50B69B7D288B1C > loramac set rx2_dr 3 2019-07-18 11:08:42,345 - INFO # loramac set rx2_dr 3 > loramac set dr 5 2019-07-18 11:08:50,216 - INFO # loramac set dr 5 > loramac tx "rwan task03" cnf 123 2019-07-18 11:09:02,971 - INFO # loramac tx "rwan task03" cnf 123 2019-07-18 11:09:04,110 - INFO # Received ACK from network 2019-07-18 11:09:04,113 - INFO # Message sent with success > loramac tx "rwan task03" uncnf 42 2019-07-18 11:09:22,121 - INFO # loramac tx "rwan task03" uncnf 42 2019-07-18 11:09:25,170 - INFO # Message sent with success ``` ![image](https://user-images.githubusercontent.com/23060007/61444879-8c6be280-a94c-11e9-83ce-016dc0e67ae4.png)
fjmolinas commented 5 years ago
11-lorawan Task 4 Passes ``` 2019-07-18 11:10:50,838 - INFO # main(): This is RIOT! (Version: 2019.10-devel-6-g9bb81-2019.07-branch) 2019-07-18 11:10:50,841 - INFO # All up, running the shell now > loramac get deveui 2019-07-18 11:10:54,333 - INFO # loramac get deveui 2019-07-18 11:10:54,335 - INFO # DEVEUI: 0000000000000000 > loramac get appeui 2019-07-18 11:10:57,218 - INFO # loramac get appeui 2019-07-18 11:10:57,221 - INFO # APPEUI: 0000000000000000 > loramac get appkey 2019-07-18 11:10:59,635 - INFO # loramac get appkey 2019-07-18 11:10:59,638 - INFO # APPKEY: 00000000000000000000000000000000 > loramac get devaddr 2019-07-18 11:11:03,732 - INFO # loramac get devaddr 2019-07-18 11:11:03,733 - INFO # DEVADDR: 00000000 > loramac get appskey 2019-07-18 11:11:06,518 - INFO # loramac get appskey 2019-07-18 11:11:06,522 - INFO # APPSKEY: 00000000000000000000000000000000 > loramac get nwkskey 2019-07-18 11:11:09,797 - INFO # loramac get nwkskey 2019-07-18 11:11:09,801 - INFO # NWKSKEY: 00000000000000000000000000000000 > loramac set deveui 0011223344556677 2019-07-18 11:11:12,602 - INFO # loramac set deveui 0011223344556677 > loramac set appeui 0011223344556677 2019-07-18 11:11:14,535 - INFO # loramac set appeui 0011223344556677 > loramac set appkey 00112233445566770011223344556677 2019-07-18 11:11:17,024 - INFO # loramac set appkey 00112233445566770011223344556677 > loramac save 2019-07-18 11:11:20,068 - INFO # loramac save > reboot 2019-07-18 11:11:23,283 - INFO # reboot 2019-07-18 11:11:23,364 - INFO # main(): This is RIOT! (Version: 2019.10-devel-6-g9bb81-2019.07-branch) 2019-07-18 11:11:23,366 - INFO # All up, running the shell now > loramac get deveui 2019-07-18 11:11:25,301 - INFO # loramac get deveui 2019-07-18 11:11:25,303 - INFO # DEVEUI: 0011223344556677 > loramac get appeui 2019-07-18 11:11:28,867 - INFO # loramac get appeui 2019-07-18 11:11:28,869 - INFO # APPEUI: 0011223344556677 > loramac get appkey 2019-07-18 11:11:31,537 - INFO # loramac get appkey 2019-07-18 11:11:31,540 - INFO # APPKEY: 00112233445566770011223344556677 > loramac erase 2019-07-18 11:11:34,595 - INFO # loramac erase > loramac set devaddr 00112233 2019-07-18 11:11:43,483 - INFO # loramac set devaddr 00112233 > loramac set appskey 00112233445566770011223344556677 2019-07-18 11:11:46,065 - INFO # loramac set appskey 00112233445566770011223344556677 > loramac set nwkskey 00112233445566770011223344556677 2019-07-18 11:11:48,852 - INFO # loramac set nwkskey 00112233445566770011223344556677 > loramac save 2019-07-18 11:11:52,068 - INFO # loramac save > reboot 2019-07-18 11:11:55,270 - INFO # reboot 2019-07-18 11:11:55,351 - INFO # main(): This is RIOT! (Version: 2019.10-devel-6-g9bb81-2019.07-branch) 2019-07-18 11:11:55,353 - INFO # All up, running the shell now > loramac get devaddr 2019-07-18 11:11:58,443 - INFO # loramac get devaddr 2019-07-18 11:11:58,445 - INFO # DEVADDR: 00112233 > loramac get appskey 2019-07-18 11:12:00,565 - INFO # loramac get appskey 2019-07-18 11:12:00,569 - INFO # APPSKEY: 00112233445566770011223344556677 > loramac get nwkskey 2019-07-18 11:12:03,483 - INFO # loramac get nwkskey 2019-07-18 11:12:03,486 - INFO # NWKSKEY: 00112233445566770011223344556677 ```
MrKevinWeiss commented 5 years ago
10-icmpv6-error Task 9 ``` srp1(Ether(dst="76:36:19:35:49:50") / IPv6(src="fe80::5c35:feff:fe40:d09a", dst="fe80::7436:19ff:fe35:4950", plen=64) / UDP(dport=48879) / "", iface="tapbr0", timeout=10) Begin emission: Finished sending 1 packets. * Received 1 packets, got 1 answers, remaining 0 packets >>>>>
MrKevinWeiss commented 5 years ago

@fjmolinas Very nice, thanks (is that for RC1 or devel)?

fjmolinas commented 5 years ago

@MrKevinWeiss Oh I actually had checkout 2019.07-branch. Should I remove the checks then (they where all failing for RC1)? I guess I'm a little bit lost with the procedure..

MrKevinWeiss commented 5 years ago

Well it is good to verify fixes fix that. I think it is fine. I will try to create RC2 and they should be retested there.

fjmolinas commented 5 years ago

@MrKevinWeiss do all tests need to be re-run for every RC?

fjmolinas commented 5 years ago
8-interop Task 3 Passes in RC1 - RIOT iotlab-m3 ``` > udp send fe80::0212:4b00:0413:3168 3000 "Hi I'm RIOT-iotlabm3" 2019-07-18 11:33:19,447 - INFO # udp send fe80::0212:4b00:0413:3168 3000 "Hi I'm RIOT-iotlabm3" 2019-07-18 11:33:19,453 - INFO # Success: sent 20 byte(s) to [fe80::0212:4b00:0413:3168]:3000 2019-07-18 11:33:19,459 - INFO # PKTDUMP: data received: 2019-07-18 11:33:19,460 - INFO # ~~ SNIP 0 - size: 20 byte, type: NETTYPE_UNDEF (0) 2019-07-18 11:33:19,461 - INFO # 00000000 48 69 20 49 27 6D 20 52 49 4F 54 2D 69 6F 74 6C 2019-07-18 11:33:19,462 - INFO # 00000010 61 62 6D 33 2019-07-18 11:33:19,463 - INFO # ~~ SNIP 1 - size: 8 byte, type: NETTYPE_UDP (4) 2019-07-18 11:33:19,464 - INFO # src-port: 3000 dst-port: 3000 2019-07-18 11:33:19,464 - INFO # length: 28 cksum: 0xca33 2019-07-18 11:33:19,465 - INFO # ~~ SNIP 2 - size: 40 byte, type: NETTYPE_IPV6 (2) 2019-07-18 11:33:19,466 - INFO # traffic class: 0x00 (ECN: 0x0, DSCP: 0x00) 2019-07-18 11:33:19,466 - INFO # flow label: 0x00000 2019-07-18 11:33:19,467 - INFO # length: 28 next header: 17 hop limit: 64 2019-07-18 11:33:19,467 - INFO # source address: fe80::212:4b00:413:3168 2019-07-18 11:33:19,475 - INFO # destination address: fe80::1711:6b10:65fb:bc06 2019-07-18 11:33:19,477 - INFO # ~~ SNIP 3 - size: 18 byte, type: NETTYPE_NETIF (-1) 2019-07-18 11:33:19,477 - INFO # if_pid: 7 rssi: -44 lqi: 255 2019-07-18 11:33:19,478 - INFO # flags: BROADCAST 2019-07-18 11:33:19,479 - INFO # src_l2addr: 00:12:4B:00:04:13:31:68 2019-07-18 11:33:19,480 - INFO # dst_l2addr: FF:FF 2019-07-18 11:33:19,481 - INFO # ~~ PKT - 4 snips, total size: 86 byte udp send fe80::0212:4b00:0413:3168 3000 "Hi I'm RIOT-iotlabm3"> 2019-07-18 11:33:20,599 - INFO # udp send fe80::0212:4b00:0413:3168 3000 "Hi I'm RIOT-iotlabm3" 2019-07-18 11:33:20,601 - INFO # Success: sent 20 byte(s) to [fe80::0212:4b00:0413:3168]:3000 2019-07-18 11:33:20,602 - INFO # PKTDUMP: data received: 2019-07-18 11:33:20,603 - INFO # ~~ SNIP 0 - size: 20 byte, type: NETTYPE_UNDEF (0) 2019-07-18 11:33:20,605 - INFO # 00000000 48 69 20 49 27 6D 20 52 49 4F 54 2D 69 6F 74 6C 2019-07-18 11:33:20,606 - INFO # 00000010 61 62 6D 33 2019-07-18 11:33:20,608 - INFO # ~~ SNIP 1 - size: 8 byte, type: NETTYPE_UDP (4) 2019-07-18 11:33:20,608 - INFO # src-port: 3000 dst-port: 3000 2019-07-18 11:33:20,609 - INFO # length: 28 cksum: 0xca33 2019-07-18 11:33:20,610 - INFO # ~~ SNIP 2 - size: 40 byte, type: NETTYPE_IPV6 (2) 2019-07-18 11:33:20,610 - INFO # traffic class: 0x00 (ECN: 0x0, DSCP: 0x00) 2019-07-18 11:33:20,611 - INFO # flow label: 0x00000 2019-07-18 11:33:20,611 - INFO # length: 28 next header: 17 hop limit: 64 2019-07-18 11:33:20,612 - INFO # source address: fe80::212:4b00:413:3168 2019-07-18 11:33:20,612 - INFO # destination address: fe80::1711:6b10:65fb:bc06 2019-07-18 11:33:20,613 - INFO # ~~ SNIP 3 - size: 18 byte, type: NETTYPE_NETIF (-1) 2019-07-18 11:33:20,613 - INFO # if_pid: 7 rssi: -46 lqi: 255 2019-07-18 11:33:20,614 - INFO # flags: BROADCAST 2019-07-18 11:33:20,623 - INFO # src_l2addr: 00:12:4B:00:04:13:31:68 2019-07-18 11:33:20,624 - INFO # dst_l2addr: FF:FF 2019-07-18 11:33:20,626 - INFO # ~~ PKT - 4 snips, total size: 86 byte udp send fe80::0212:4b00:0413:3168 3000 "Hi I'm RIOT-iotlabm3"> 2019-07-18 11:33:21,726 - INFO # udp send fe80::0212:4b00:0413:3168 3000 "Hi I'm RIOT-iotlabm3" 2019-07-18 11:33:21,727 - INFO # Success: sent 20 byte(s) to [fe80::0212:4b00:0413:3168]:3000 2019-07-18 11:33:21,727 - INFO # PKTDUMP: data received: 2019-07-18 11:33:21,728 - INFO # ~~ SNIP 0 - size: 20 byte, type: NETTYPE_UNDEF (0) 2019-07-18 11:33:21,729 - INFO # 00000000 48 69 20 49 27 6D 20 52 49 4F 54 2D 69 6F 74 6C 2019-07-18 11:33:21,729 - INFO # 00000010 61 62 6D 33 2019-07-18 11:33:21,729 - INFO # ~~ SNIP 1 - size: 8 byte, type: NETTYPE_UDP (4) 2019-07-18 11:33:21,730 - INFO # src-port: 3000 dst-port: 3000 2019-07-18 11:33:21,742 - INFO # length: 28 cksum: 0xca33 2019-07-18 11:33:21,743 - INFO # ~~ SNIP 2 - size: 40 byte, type: NETTYPE_IPV6 (2) 2019-07-18 11:33:21,745 - INFO # traffic class: 0x00 (ECN: 0x0, DSCP: 0x00) 2019-07-18 11:33:21,745 - INFO # flow label: 0x00000 2019-07-18 11:33:21,747 - INFO # length: 28 next header: 17 hop limit: 64 2019-07-18 11:33:21,747 - INFO # source address: fe80::212:4b00:413:3168 2019-07-18 11:33:21,749 - INFO # destination address: fe80::1711:6b10:65fb:bc06 2019-07-18 11:33:21,750 - INFO # ~~ SNIP 3 - size: 18 byte, type: NETTYPE_NETIF (-1) 2019-07-18 11:33:21,751 - INFO # if_pid: 7 rssi: -45 lqi: 255 2019-07-18 11:33:21,751 - INFO # flags: BROADCAST 2019-07-18 11:33:21,752 - INFO # src_l2addr: 00:12:4B:00:04:13:31:68 2019-07-18 11:33:21,752 - INFO # dst_l2addr: FF:FF 2019-07-18 11:33:21,752 - INFO # ~~ PKT - 4 snips, total size: 86 byte ``` - RIOT cc2538dk ``` 2019-07-18 11:32:14,460 - INFO # Contiki-3.x-3345-g32b5b17f6 2019-07-18 11:32:14,461 - INFO # TI SmartRF06 + cc2538EM 2019-07-18 11:32:14,463 - INFO # CC2538: ID: 0xb964, rev.: PG2.0, Flash: 512 KiB, SRAM: 32 KiB, AES/SHA: 1, ECC/RSA: 1 2019-07-18 11:32:14,476 - INFO # System clock: 16000000 Hz 2019-07-18 11:32:14,477 - INFO # I/O clock: 16000000 Hz 2019-07-18 11:32:14,478 - INFO # Reset cause: External reset 2019-07-18 11:32:14,479 - INFO # Net: sicslowpan 2019-07-18 11:32:14,479 - INFO # MAC: CSMA 2019-07-18 11:32:14,479 - INFO # RDC: nullrdc 2019-07-18 11:32:14,480 - INFO # Rime configured with address 00:12:4b:00:04:13:31:68 2019-07-18 11:32:14,492 - INFO # Starting UDP echo server 2019-07-18 11:32:14,493 - INFO # Listen port: 3000, TTL=64 2019-07-18 11:33:07,067 - INFO # 20 bytes from [fe80::1711:6b10:65fb:bc06]:3000 2019-07-18 11:33:16,491 - INFO # 20 bytes from [fe80::1711:6b10:65fb:bc06]:3000 2019-07-18 11:33:19,451 - INFO # 20 bytes from [fe80::1711:6b10:65fb:bc06]:3000 2019-07-18 11:33:20,601 - INFO # 20 bytes from [fe80::1711:6b10:65fb:bc06]:3000 2019-07-18 11:33:21,722 - INFO # 20 bytes from [fe80::1711:6b10:65fb:bc06]:3000 ```
MrKevinWeiss commented 5 years ago
10-icmpv6-error Task 8 ``` srp1(Ether(dst="76:36:19:35:49:50") / IPv6(src="beef::1", dst="affe::1", hlim=1) / UDP(dport=48879) / "", iface="tapbr0", timeout=10) Begin emission: Finished sending 1 packets. * Received 1 packets, got 1 answers, remaining 0 packets >>>>>
MrKevinWeiss commented 5 years ago

ideally yes. Practically it is a judgement call. If the only difference in an RC is, say a fix to a board gpio then I would be ok skipping it but if there was a fix in gnrc and in, say, msg handling then I probably would want to make sure that all tests are run again. Just so the stomp out one bug then two more appear phenomenon doesn't happen.

MrKevinWeiss commented 5 years ago

10-icmpv6-error Task 10 run riot-release-10-10.py with the following params:

sudo python3 riot-release-10-10.py tapbr0 "fe80::7436:19ff:fe35:4950" "fe80::5c35:feff:fe40:d09a" "76:36:19:35:49:50" "5e:35:fe:40:d0:9a"

No errors

fjmolinas commented 5 years ago

2-tests Task 02 - Subset of tests on iotlab-m3 PASSED?

ERROR:iotlab-m3:Tests failed: 5
Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)

EDIT: re-ran the gnrc ones needing sudo with sudo, and they are passing.

MrKevinWeiss commented 5 years ago

02-1 passed but I needed to manually do sudo from some tests and run BUILD_IN_DOCKER=1 for cpp tests (since it isn't setup)

MrKevinWeiss commented 5 years ago

~@fjmolinas odd to put those links in~ <= ahh copy and paste. I guess the gnrc stuff needs sudo and I the fatfs needs an sd card or something special on the sd card... It is a pretty special case.

cladmi commented 5 years ago

It says Tests failed: 5 with 4 tests listed.

MrKevinWeiss commented 5 years ago

arrays start at 2

fjmolinas commented 5 years ago

It says Tests failed: 5 with 4 tests listed.

Yep I was implementing a python test script for 11-lorawan and when checking out the RC1 branch it didn't get removed. I didn't want to re-run the tests because of that.

fjmolinas commented 5 years ago

@fjmolinas odd to put those links in <= ahh copy and paste. I guess the gnrc stuff needs sudo and I the fatfs needs an sd card or something special on the sd card... It is a pretty special case.

I'll mark as passing sin I re-ran those 3 with sudo and they are passing. Running for samr21 now..

fjmolinas commented 5 years ago

99-compile-and-test-one-board Task #01 - Run tests on different hardwares

I could leave it running over night for 4 boards, any preferences? @MrKevinWeiss

MrKevinWeiss commented 5 years ago

Oh very nice @fjmolinas I really appreciate the help. I would say choose ones that don't have known flashing or term problems and different cpus.

cladmi commented 5 years ago

I can run the tests again on arduino-mega2560 cc2650-launchpad frdm-k64f frdm-kw41z msba2 mulle nrf52dk nucleo-f103rb pba-d-01-kw2x sltb001a stm32f3discovery

fjmolinas commented 5 years ago
8-interop Task 10 Passes in RC1 - LWIP node: ``` �main(): This is RIOT! (Version: 2019.10-devel-HEAD) RIOT lwip test application > udp server start 3000 udp server start 3000 Success: started UDP server on port 3000 > help udp help udp Command Description --------------------------------------- ip Send IP packets and listen for packets of certain type tcp Send TCP messages and listen for messages on TCP port udp Send UDP messages and listen for messages on UDP port ifconfig Shows assigned IPv6 addresses reboot Reboot the node ps Prints information about running threads. random_init initializes the PRNG random_get returns 32 bit of pseudo randomness > udp send udp send usage: udp send [ []] > udp send fe80::1711:6b10:65f6:bc02 udp send fe80::1711:6b10:65f6:bc02 usage: udp send [ []] > udp send fe80::1711:6b10:65f6:bc02 3000 12345678 udp send fe80::1711:6b10:65f6:bc02 3000 12345678 Success: send 4 byte over UDP to [fe80::1711:6b10:65f6:bc02]:3000 > ifconfig ifconfig L6_00: inet6 fe80::1711:6b10:65f8:bc36 > Received UDP data from [fe80::1711:6b10:65f6:bc02]:1026: 00000000 12 34 56 78 ``` - emb6 node ``` RIOT emb6 test application > help help Command Description --------------------------------------- ping6 Send pings and receive pongs udp Send UDP messages and listen for messages on UDP port ifconfig Shows assigned IPv6 addresses reboot Reboot the node ps Prints information about running threads. random_init initializes the PRNG random_get returns 32 bit of pseudo randomness > udp server start 3000 udp server start 3000 Success: started UDP server on port 3000 > ifconfig ifconfig 0: inet6 fe80::1711:6b10:65f6:bc02 > Received from [fe80::1711:6b10:65f8:bc36]:3000: 00000000 12 34 56 78 udp send fe80::1711:6b10:65f8:bc36 3000 12345678 udp send fe80::1711:6b10:65f8:bc36 3000 12345678 Success: send 4 byte to [fe80::1711:6b10:65f8:bc36]:3000) ```
cladmi commented 5 years ago

As said in https://github.com/RIOT-OS/Release-Specs/issues/128#issuecomment-511451764 01/task2 and 01/task3 worked. The 01/Task4 works on the 2019.07-branch as https://github.com/RIOT-OS/RIOT/pull/11858 was merged.

But I cannot tick the checkbox.

fjmolinas commented 5 years ago
8-interop Task 9 Passes in RC1 - gnrc node ``` �main(): This is RIOT! (Version: 2019.10-devel-HEAD) RIOT network stack example application All up, running the shell now > ifconfig ifconfig Iface 7 HWaddr: 3C:36 Channel: 26 Page: 0 NID: 0x23 Long HWaddr: 15:11:6B:10:65:F8:BC:36 TX-Power: 0dBm State: IDLE max. Retrans.: 3 CSMA Retries: 4 AUTOACK ACK_REQ CSMA L2-PDU:102 MTU:1280 HL:64 RTR 6LO IPHC Source address length: 8 Link type: wireless inet6 addr: fe80::1711:6b10:65f8:bc36 scope: local VAL inet6 group: ff02::2 inet6 group: ff02::1 inet6 group: ff02::1:fff8:bc36 inet6 group: ff02::1a Statistics for Layer 2 RX packets 3 bytes 177 TX packets 5 (Multicast: 5) bytes 201 TX succeeded 5 errors 0 Statistics for IPv6 RX packets 3 bytes 240 TX packets 5 (Multicast: 5) bytes 306 TX succeeded 5 errors 0 > udp server start 3000 udp server start 3000 Success: started UDP server on port 3000 > PKTDUMP: data received: ~~ SNIP 0 - size: 4 byte, type: NETTYPE_UNDEF (0) 00000000 12 34 56 78 ~~ SNIP 1 - size: 8 byte, type: NETTYPE_UDP (4) src-port: 1026 dst-port: 3000 length: 12 cksum: 0x4203 ~~ SNIP 2 - size: 40 byte, type: NETTYPE_IPV6 (2) traffic class: 0x00 (ECN: 0x0, DSCP: 0x00) flow label: 0x00000 length: 12 next header: 17 hop limit: 64 source address: fe80::1711:6b10:65f6:bc02 destination address: fe80::1711:6b10:65f8:bc36 ~~ SNIP 3 - size: 24 byte, type: NETTYPE_NETIF (-1) if_pid: 7 rssi: -44 lqi: 255 flags: 0x0 src_l2addr: 15:11:6B:10:65:F6:BC:02 dst_l2addr: 15:11:6B:10:65:F8:BC:36 ~~ PKT - 4 snips, total size: 76 byte udp send fe80::1711:6b10:65f6:bc02 3000 12345678 udp send fe80::1711:6b10:65f6:bc02 3000 12345678 Success: sent 8 byte(s) to [fe80::1711:6b10:65f6:bc02]:3000 ``` - emb6 node ``` �main(): This is RIOT! (Version: 2019.10-devel-HEAD) RIOT emb6 test application > help help Command Description --------------------------------------- ping6 Send pings and receive pongs udp Send UDP messages and listen for messages on UDP port ifconfig Shows assigned IPv6 addresses reboot Reboot the node ps Prints information about running threads. random_init initializes the PRNG random_get returns 32 bit of pseudo randomness > udp server start 3000 udp server start 3000 Success: started UDP server on port 3000 > ifconfig ifconfig 0: inet6 fe80::1711:6b10:65f6:bc02 > Received from [fe80::1711:6b10:65f8:bc36]:3000: 00000000 12 34 56 78 udp send fe80::1711:6b10:65f8:bc36 3000 12345678 udp send fe80::1711:6b10:65f8:bc36 3000 12345678 Success: send 4 byte to [fe80::1711:6b10:65f8:bc36]:3000) > reboot reboot �main(): This is RIOT! (Version: 2019.10-devel-HEAD) RIOT emb6 test application > ifconfig ifconfig 0: inet6 fe80::1711:6b10:65f6:bc02 > udp server start 3000 udp server start 3000 Success: started UDP server on port 3000 > udp send fe80::1711:6b10:65f8:bc36 3000 12345678 udp send fe80::1711:6b10:65f8:bc36 3000 12345678 Success: send 4 byte to [fe80::1711:6b10:65f8:bc36]:3000) > Received from [fe80::1711:6b10:65f8:bc36]:3000: 00000000 31 32 33 34 35 36 37 38 ```
fjmolinas commented 5 years ago
8-interop Task 8 Passes in RC1 - lwip node ``` �main(): This is RIOT! (Version: 2019.10-devel-HEAD) RIOT lwip test application > udp server start 3000 udp server start 3000 Success: started UDP server on port 3000 > ifconfig ifconfig L6_00: inet6 fe80::1711:6b10:65f6:bc02 > udp send fe80::1711:6b10:65f8:bc36 3000 12345678 udp send fe80::1711:6b10:65f8:bc36 3000 12345678 Success: send 4 byte over UDP to [fe80::1711:6b10:65f8:bc36]:3000 > Received UDP data from [fe80::1711:6b10:65f8:bc36]:3000: 00000000 31 32 33 34 35 36 37 38 ``` - RIOT node ``` RIOT network stack example application All up, running the shell now > udp server start 3000 udp server start 3000 Success: started UDP server on port 3000 > ifconfig ifconfig Iface 7 HWaddr: 3C:36 Channel: 26 Page: 0 NID: 0x23 Long HWaddr: 15:11:6B:10:65:F8:BC:36 TX-Power: 0dBm State: IDLE max. Retrans.: 3 CSMA Retries: 4 AUTOACK ACK_REQ CSMA L2-PDU:102 MTU:1280 HL:64 RTR 6LO IPHC Source address length: 8 Link type: wireless inet6 addr: fe80::1711:6b10:65f8:bc36 scope: local VAL inet6 group: ff02::2 inet6 group: ff02::1 inet6 group: ff02::1:fff8:bc36 inet6 group: ff02::1a Statistics for Layer 2 RX packets 4 bytes 177 TX packets 5 (Multicast: 5) bytes 201 TX succeeded 5 errors 0 Statistics for IPv6 RX packets 2 bytes 128 TX packets 5 (Multicast: 5) bytes 306 TX succeeded 5 errors 0 > PKTDUMP: data received: ~~ SNIP 0 - size: 4 byte, type: NETTYPE_UNDEF (0) 00000000 12 34 56 78 ~~ SNIP 1 - size: 8 byte, type: NETTYPE_UDP (4) src-port: 3000 dst-port: 3000 length: 12 cksum: 0x3a4d ~~ SNIP 2 - size: 40 byte, type: NETTYPE_IPV6 (2) traffic class: 0x00 (ECN: 0x0, DSCP: 0x00) flow label: 0x00000 length: 12 next header: 17 hop limit: 255 source address: fe80::1711:6b10:65f6:bc02 destination address: fe80::1711:6b10:65f8:bc36 ~~ SNIP 3 - size: 24 byte, type: NETTYPE_NETIF (-1) if_pid: 7 rssi: -44 lqi: 255 flags: 0x0 src_l2addr: 15:11:6B:10:65:F6:BC:02 dst_l2addr: 15:11:6B:10:65:F8:BC:36 ~~ PKT - 4 snips, total size: 76 byte udp send fe80::1711:6b10:65f6:bc02 3000 12345678 udp send fe80::1711:6b10:65f6:bc02 3000 12345678 Success: sent 8 byte(s) to [fe80::1711:6b10:65f6:bc02]:3000 ```
fjmolinas commented 5 years ago

2-tests Task 03 - Subset of tests on samr21-xpro PASSED

ERROR:samr21-xpro:Tests failed: 4
Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)

The first 3 succeed when running with sudo

miri64 commented 5 years ago

@fjmolinas: @aabadie should have one of those lying around: https://doc.riot-os.org/group__drivers__io1__xplained.html (he wrote the driver). Maybe the fourth succeeds with that.

smlng commented 5 years ago

interop 8 task 02: works with link local and global (ULA) addresses

smlng commented 5 years ago

interop 8 task 04: works bidirectional when using CFLAGS += -DGNRC_IPV6_NIB_CONF_SLAAC=1. It also works from Internet host to RIOT w/o that flag, but not from RIOT to Internet host. The latter is weird because it means that source address selection (or exclusion) is different when RIOT is initial sender or only responder - though I assume, that when responding RIOT just switches src and dst addresses w/o checking validity of its own source address.

MrKevinWeiss commented 5 years ago

Closing in favor of #133

cladmi commented 5 years ago

The arduino-mega2560 did not run due to crap hardware.


#### cc2650-launchpad/failuresummary.md

Failures during test:
- [tests/cond_order](tests/cond_order/test.failed)
- [tests/driver_grove_ledbar](tests/driver_grove_ledbar/test.failed)
- [tests/driver_my9221](tests/driver_my9221/test.failed)
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/periph_timer](tests/periph_timer/test.failed)
- [tests/ps_schedstatistics](tests/ps_schedstatistics/test.failed)

#### frdm-k64f/failuresummary.md

Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/periph_timer](tests/periph_timer/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/ps_schedstatistics](tests/ps_schedstatistics/test.failed)

#### frdm-kw41z/failuresummary.md

Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/ps_schedstatistics](tests/ps_schedstatistics/test.failed)
- [tests/thread_flags](tests/thread_flags/test.failed)
- [tests/unittests](tests/unittests/test.failed)
- [tests/xtimer_periodic_wakeup](tests/xtimer_periodic_wakeup/test.failed)
- [tests/xtimer_usleep](tests/xtimer_usleep/test.failed)

#### msba2/failuresummary.md

Failures during test:
- [tests/driver_grove_ledbar](tests/driver_grove_ledbar/test.failed)
- [tests/driver_my9221](tests/driver_my9221/test.failed)
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sixlowpan](tests/gnrc_sixlowpan/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/libfixmath](tests/libfixmath/test.failed)
- [tests/libfixmath_unittests](tests/libfixmath_unittests/test.failed)
- [tests/lwip_sock_tcp](tests/lwip_sock_tcp/test.failed)
- [tests/periph_rtc](tests/periph_rtc/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/pkg_libcose](tests/pkg_libcose/test.failed)
- [tests/pkg_qdsa](tests/pkg_qdsa/test.failed)
- [tests/pkg_relic](tests/pkg_relic/test.failed)
- [tests/pkg_tweetnacl](tests/pkg_tweetnacl/test.failed)
- [tests/pthread_tls](tests/pthread_tls/test.failed)
- [tests/unittests](tests/unittests/test.failed)
- [tests/xtimer_periodic_wakeup](tests/xtimer_periodic_wakeup/test.failed)

#### mulle/failuresummary.md

Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/periph_timer](tests/periph_timer/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/pkg_littlefs](tests/pkg_littlefs/test.failed)
- [tests/pkg_spiffs](tests/pkg_spiffs/test.failed)
- [tests/shell](tests/shell/test.failed)

#### nrf52dk/failuresummary.md

Failures during compilation:
- [tests/mcuboot](tests/mcuboot/compilation.failed)

Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)

#### nucleo-f103rb/failuresummary.md

Failures during test:
- [tests/driver_grove_ledbar](tests/driver_grove_ledbar/test.failed)
- [tests/driver_hd44780](tests/driver_hd44780/test.failed)
- [tests/driver_my9221](tests/driver_my9221/test.failed)
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/xtimer_periodic_wakeup](tests/xtimer_periodic_wakeup/test.failed)
- [tests/xtimer_usleep_short](tests/xtimer_usleep_short/test.failed)

#### pba-d-01-kw2x/failuresummary.md

Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/ps_schedstatistics](tests/ps_schedstatistics/test.failed)

#### sltb001a/failuresummary.md

Failures during test:
- [tests/embunit](tests/embunit/test.failed)
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/periph_gpio](tests/periph_gpio/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
- [tests/ps_schedstatistics](tests/ps_schedstatistics/test.failed)
- [tests/xtimer_periodic_wakeup](tests/xtimer_periodic_wakeup/test.failed)

#### stm32f3discovery/failuresummary.md

Failures during test:
- [tests/gnrc_ipv6_ext](tests/gnrc_ipv6_ext/test.failed)
- [tests/gnrc_rpl_srh](tests/gnrc_rpl_srh/test.failed)
- [tests/gnrc_sock_dns](tests/gnrc_sock_dns/test.failed)
- [tests/pkg_fatfs_vfs](tests/pkg_fatfs_vfs/test.failed)
miri64 commented 5 years ago

interop 8 task 04: works bidirectional when using CFLAGS += -DGNRC_IPV6_NIB_CONF_SLAAC=1. It also works from Internet host to RIOT w/o that flag, but not from RIOT to Internet host. The latter is weird because it means that source address selection (or exclusion) is different when RIOT is initial sender or only responder - though I assume, that when responding RIOT just switches src and dst addresses w/o checking validity of its own source address.

It's not weird, because for ping reply the source address is known (the one the sender of the echo request used as destination address), so that is used. If you are the sender of an echo request it has to be determined first, so source address selection is triggered.

smlng commented 5 years ago

mhm, yeah sure the source address is known (as I wrote: just switch src and dst addresses) - however, it might be invalid and hence should not be used?!

miri64 commented 5 years ago

You are right. A check in gnrc_ipv6 is needed for that. However, this is a minor issue and should not be blocking for the release.

MrKevinWeiss commented 5 years ago

However, this is a minor issue and should not be blocking for the release.

:relieved: