MONROE-PROJECT / Maintenance

MONROE Maintenance procedures, and mostly an issue tracker.
0 stars 0 forks source link

[Node 83] Tracking Issue #95

Closed alfs closed 6 years ago

alfs commented 7 years ago

Two modems were grey, assigned PID 1408. mf910-reboot didn't work. Third modems had dmesg usb -32 errors.

I rebooted modems manually (power button). lsusb now shows all three modems as PID 1408. usb0, 1, 2 are up, but no address is assigned.

alfs commented 7 years ago

Node has been restarted several times, getting many usb hub crashes and usb error -71's.

monroe@Monroe000db94004c0:~$ uptime
 00:05:16 up 26 min,  1 user,  load average: 1.62, 1.72, 1.21
monroe@Monroe000db94004c0:~$ dmesg | grep f2f7
[ 1306.737506] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[ 1314.653458] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[ 1317.245547] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[ 1319.297564] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[ 1320.593490] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[ 1321.433445] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[ 1336.749558] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[ 1340.413390] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[ 1358.525446] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[ 1389.813381] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[ 1417.397333] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
...
monroe@Monroe000db94004c0:~$ dmesg |grep usb |grep error|head
[ 1330.290211] usb 1-5: device not accepting address 6, error -71
[ 1331.338234] usb 1-5: device not accepting address 8, error -71
[ 1341.238211] usb 1-5: device not accepting address 29, error -71
[ 1343.950203] usb 1-5: device not accepting address 33, error -71
[ 1346.370747] usb 1-5: device descriptor read/all, error -71
[ 1356.939347] usb 1-5.4: device descriptor read/all, error -71
[ 1360.586143] usb 1-5: device not accepting address 72, error -71
[ 1361.798144] usb 1-5: device not accepting address 74, error -71
[ 1363.858149] usb 1-5: device not accepting address 77, error -71
alfs commented 7 years ago

One modem (Telia) is unplugged and node is restarted to see if this helps with USB problems.

alfs commented 7 years ago

Didn't help. USB hub is not visible in lsusb, and lots of usb errors in the kernel log. One of the modems reported 'low battery'. Unplugged a second mifi (unknown which; display didn't light up on any of the two remaining modems).

monroe@Monroe000db94004c0:~$ uptime
 17:13:20 up  1:20,  1 user,  load average: 1.73, 1.63, 1.58
monroe@Monroe000db94004c0:~$ lsusb 
Bus 003 Device 002: ID 058f:6366 Alcor Micro Corp. Multi Flash Reader
Bus 003 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 007 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
Bus 006 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
Bus 002 Device 002: ID 1199:68c0 Sierra Wireless, Inc. 
Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 005 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 004 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
monroe@Monroe000db94004c0:~$ dmesg |head
[ 4455.365343] usb 4-5: device not accepting address 102, error -62
[ 4455.653297] usb 1-5: device not accepting address 51, error -71
[ 4456.041161] usb 4-5: new full-speed USB device number 104 using ohci-pci
[ 4456.357179] usb 1-5: new high-speed USB device number 53 using ehci-pci
[ 4456.585137] usb 4-5: device not accepting address 104, error -62
[ 4456.837118] usb 1-5: new high-speed USB device number 54 using ehci-pci
[ 4457.373005] usb 1-5: device not accepting address 54, error -71
[ 4457.748949] usb 4-5: new full-speed USB device number 106 using ohci-pci
[ 4457.996856] usb 1-5: new high-speed USB device number 56 using ehci-pci
[ 4458.532716] usb 1-5: device not accepting address 56, error -71
monroe@Monroe000db94004c0:~$ 
alfs commented 7 years ago

Still problems. Disconnecting all modems and powering down/up.

monroe@Monroe000db94004c0:~$ uptime
 17:41:24 up 21 min,  1 user,  load average: 1.91, 1.45, 1.01
monroe@Monroe000db94004c0:~$ lsusb 
Bus 003 Device 002: ID 058f:6366 Alcor Micro Corp. Multi Flash Reader
Bus 003 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 007 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
Bus 006 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
Bus 002 Device 002: ID 1199:68c0 Sierra Wireless, Inc. 
Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 005 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 004 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
monroe@Monroe000db94004c0:~$ dmesg | head
[ 1152.292206] usb 1-5: USB disconnect, device number 76
[ 1152.757636] usb 1-5.1: device not accepting address 77, error -71
[ 1153.005633] usb 1-5: new high-speed USB device number 81 using ehci-pci
[ 1153.138057] usb 1-5: New USB device found, idVendor=0424, idProduct=2514
[ 1153.138073] usb 1-5: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 1153.139445] hub 1-5:1.0: USB hub found
[ 1153.139536] hub 1-5:1.0: 4 ports detected
[ 1153.172108] usb 1-5: USB disconnect, device number 81
[ 1153.409617] usb 1-5: new high-speed USB device number 82 using ehci-pci
[ 1153.542419] usb 1-5: New USB device found, idVendor=0424, idProduct=2514
alfs commented 7 years ago

Without any modems attached, still getting a lot of USB errors.

However, it could be related to the APU (idVendor=0424, idProduct=2514) so maybe the problems is with the APU rather than the yepkit (in this case):

monroe@Monroe000db94004c0:~$ uptime
 17:51:38 up 5 min,  1 user,  load average: 0.60, 0.37, 0.16
monroe@Monroe000db94004c0:~$ dmesg |tail
[  347.013495] usb 1-5: New USB device found, idVendor=0424, idProduct=2514
[  347.013512] usb 1-5: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[  347.014925] hub 1-5:1.0: USB hub found
[  347.015095] hub 1-5:1.0: 4 ports detected
[  347.085375] usb 1-5: USB disconnect, device number 11
[  347.325027] usb 1-5: new high-speed USB device number 12 using ehci-pci
[  347.457718] usb 1-5: New USB device found, idVendor=0424, idProduct=2514
[  347.457735] usb 1-5: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[  347.458913] hub 1-5:1.0: USB hub found
[  347.459087] hub 1-5:1.0: 4 ports detected

monroe@Monroe000db94004c0:~$ dmesg |grep f2f7
[  136.334434] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  138.034158] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  138.806023] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  139.638264] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  142.179110] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  143.019974] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  164.202006] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  165.826859] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  191.110658] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  202.042748] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  202.817627] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  208.517789] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  220.854663] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  221.689758] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  222.517509] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  253.108820] usb 4-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  255.702151] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  257.738374] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  261.673196] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  262.518060] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  265.785125] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  266.625354] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  267.454219] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  268.293956] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  278.872517] usb 4-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  283.617811] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  285.868722] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  287.333330] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  288.588670] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  289.410033] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  302.053828] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  302.889819] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  312.613660] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  313.456769] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  314.389633] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  316.852713] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  318.489564] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  319.380671] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  321.153521] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  342.284540] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  343.585395] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  348.517336] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
[  351.194173] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
monroe@Monroe000db94004c0:~$ 
alfs commented 7 years ago

I've now also disconnected the yepkit from the APU.

alfs commented 7 years ago

I unplugged the node power for 45 minutes, then reconnected the yepkit and one modem and powered up.

Getting USB trouble within 30 seconds of boot up and then later usb error -71 and -62's:

Dec 13 09:25:38 Monroe000db94004c0 kernel: [   10.092821] nfnl_acct: registering with nfnetlink.
Dec 13 09:25:38 Monroe000db94004c0 kernel: [   10.117611] ip_set: protocol 6
Dec 13 09:25:38 Monroe000db94004c0 kernel: [   10.233600] ctnetlink v0.93: registering with nfnetlink.
Dec 13 09:25:44 Monroe000db94004c0 kernel: [   15.732420] usb 1-5: USB disconnect, device number 9
Dec 13 09:25:44 Monroe000db94004c0 kernel: [   15.732434] usb 1-5.3: USB disconnect, device number 10
Dec 13 09:25:44 Monroe000db94004c0 kernel: [   15.737349] option1 ttyUSB3: GSM modem (1-port) converter now disconnected from ttyUSB3
Dec 13 09:25:44 Monroe000db94004c0 kernel: [   15.737383] option 1-5.3:1.0: device disconnected
Dec 13 09:25:44 Monroe000db94004c0 kernel: [   15.740852] usb 1-5.4: USB disconnect, device number 11
Dec 13 09:25:44 Monroe000db94004c0 kernel: [   15.984994] usb 1-5: new high-speed USB device number 12 using ehci-pci
Dec 13 09:25:44 Monroe000db94004c0 kernel: [   16.388977] usb 4-5: new full-speed USB device number 2 using ohci-pci
Dec 13 09:25:45 Monroe000db94004c0 kernel: [   16.547932] usb 4-5: not running at top speed; connect to a high speed hub
Dec 13 09:25:45 Monroe000db94004c0 kernel: [   16.551951] usb 4-5: New USB device found, idVendor=0424, idProduct=2514
Dec 13 09:25:45 Monroe000db94004c0 kernel: [   16.551968] usb 4-5: New USB device strings: Mfr=0, Product=0, SerialNumber=0
Dec 13 09:25:45 Monroe000db94004c0 kernel: [   16.556293] hub 4-5:1.0: USB hub found
Dec 13 09:25:45 Monroe000db94004c0 kernel: [   16.559126] hub 4-5:1.0: 4 ports detected
Dec 13 09:25:45 Monroe000db94004c0 kernel: [   16.892927] usb 4-5.4: new full-speed USB device number 4 using ohci-pci
Dec 13 09:25:45 Monroe000db94004c0 kernel: [   17.019957] usb 4-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
Dec 13 09:25:45 Monroe000db94004c0 kernel: [   17.019974] usb 4-5.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
Dec 13 09:25:45 Monroe000db94004c0 kernel: [   17.019982] usb 4-5.4: Product: YKUSH
Dec 13 09:25:45 Monroe000db94004c0 kernel: [   17.019990] usb 4-5.4: Manufacturer: Yepkit Lda.
Dec 13 09:25:45 Monroe000db94004c0 kernel: [   17.019997] usb 4-5.4: SerialNumber: YK21434
Dec 13 09:25:45 Monroe000db94004c0 kernel: [   17.280909] usb 4-5.3: new full-speed USB device number 5 using ohci-pci
Dec 13 09:25:45 Monroe000db94004c0 kernel: [   17.409945] usb 4-5.3: New USB device found, idVendor=19d2, idProduct=0076
Dec 13 09:25:45 Monroe000db94004c0 kernel: [   17.409962] usb 4-5.3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
Dec 13 09:25:45 Monroe000db94004c0 kernel: [   17.409971] usb 4-5.3: Product: QHSUSB__BULK
Dec 13 09:25:45 Monroe000db94004c0 kernel: [   17.409979] usb 4-5.3: Manufacturer: Qualcomm CDMA Technologies MSM
Dec 13 09:25:45 Monroe000db94004c0 kernel: [   17.412231] option 4-5.3:1.0: GSM modem (1-port) converter detected
Dec 13 09:25:45 Monroe000db94004c0 kernel: [   17.412702] usb 4-5.3: GSM modem (1-port) converter now attached to ttyUSB3
Dec 13 09:25:58 Monroe000db94004c0 kernel: [   30.095894] random: nonblocking pool is initialized
Dec 13 09:25:58 Monroe000db94004c0 kernel: [   30.290958] usb 4-5: USB disconnect, device number 2
Dec 13 09:25:58 Monroe000db94004c0 kernel: [   30.290972] usb 4-5.3: USB disconnect, device number 5
Dec 13 09:25:58 Monroe000db94004c0 kernel: [   30.295712] option1 ttyUSB3: GSM modem (1-port) converter now disconnected from ttyUSB3
Dec 13 09:25:58 Monroe000db94004c0 kernel: [   30.295747] option 4-5.3:1.0: device disconnected
Dec 13 09:25:58 Monroe000db94004c0 kernel: [   30.297590] usb 4-5.4: USB disconnect, device number 4
Dec 13 09:25:59 Monroe000db94004c0 kernel: [   30.623833] usb 1-5: new high-speed USB device number 13 using ehci-pci
Dec 13 09:25:59 Monroe000db94004c0 kernel: [   31.048012] usb 4-5: new full-speed USB device number 6 using ohci-pci
Dec 13 09:25:59 Monroe000db94004c0 kernel: [   31.228012] usb 1-5: new high-speed USB device number 14 using ehci-pci
Dec 13 09:25:59 Monroe000db94004c0 kernel: [   31.360649] usb 1-5: New USB device found, idVendor=0424, idProduct=2514
Dec 13 09:25:59 Monroe000db94004c0 kernel: [   31.360666] usb 1-5: New USB device strings: Mfr=0, Product=0, SerialNumber=0
Dec 13 09:25:59 Monroe000db94004c0 kernel: [   31.364685] hub 1-5:1.0: USB hub found
Dec 13 09:25:59 Monroe000db94004c0 kernel: [   31.365395] hub 1-5:1.0: 4 ports detected
Dec 13 09:25:59 Monroe000db94004c0 kernel: [   31.444992] usb 1-5: USB disconnect, device number 14
Dec 13 09:26:00 Monroe000db94004c0 kernel: [   31.691808] usb 1-5: new high-speed USB device number 15 using ehci-pci
Dec 13 09:26:00 Monroe000db94004c0 kernel: [   31.824122] usb 1-5: New USB device found, idVendor=0424, idProduct=2514
Dec 13 09:26:00 Monroe000db94004c0 kernel: [   31.824136] usb 1-5: New USB device strings: Mfr=0, Product=0, SerialNumber=0
Dec 13 09:26:00 Monroe000db94004c0 kernel: [   31.828186] hub 1-5:1.0: USB hub found
Dec 13 09:26:00 Monroe000db94004c0 kernel: [   31.828860] hub 1-5:1.0: 4 ports detected
Dec 13 09:26:00 Monroe000db94004c0 kernel: [   32.119785] usb 1-5.4: new full-speed USB device number 17 using ehci-pci
Dec 13 09:26:00 Monroe000db94004c0 kernel: [   32.214956] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
...
Dec 13 09:40:29 Monroe000db94004c0 kernel: [  901.187243] usb 1-5: USB disconnect, device number 41
Dec 13 09:40:29 Monroe000db94004c0 kernel: [  901.187260] usb 1-5.4: USB disconnect, device number 42
Dec 13 09:40:29 Monroe000db94004c0 kernel: [  901.431843] usb 1-5: new high-speed USB device number 43 using ehci-pci
Dec 13 09:40:30 Monroe000db94004c0 kernel: [  901.564179] usb 1-5: New USB device found, idVendor=0424, idProduct=2514
Dec 13 09:40:30 Monroe000db94004c0 kernel: [  901.564196] usb 1-5: New USB device strings: Mfr=0, Product=0, SerialNumber=0
Dec 13 09:40:30 Monroe000db94004c0 kernel: [  901.570970] hub 1-5:1.0: USB hub found
Dec 13 09:40:30 Monroe000db94004c0 kernel: [  901.571261] hub 1-5:1.0: 4 ports detected
Dec 13 09:40:30 Monroe000db94004c0 kernel: [  901.847821] usb 1-5.4: new full-speed USB device number 44 using ehci-pci
Dec 13 09:40:30 Monroe000db94004c0 kernel: [  901.943132] usb 1-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
Dec 13 09:40:30 Monroe000db94004c0 kernel: [  901.943149] usb 1-5.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
Dec 13 09:40:30 Monroe000db94004c0 kernel: [  901.943158] usb 1-5.4: Product: YKUSH
Dec 13 09:40:30 Monroe000db94004c0 kernel: [  901.943165] usb 1-5.4: Manufacturer: Yepkit Lda.
Dec 13 09:40:30 Monroe000db94004c0 kernel: [  901.943173] usb 1-5.4: SerialNumber: YK21434
Dec 13 09:40:35 Monroe000db94004c0 kernel: [  906.713293] usb 1-5: USB disconnect, device number 43
Dec 13 09:40:35 Monroe000db94004c0 kernel: [  906.713310] usb 1-5.4: USB disconnect, device number 44
Dec 13 09:40:35 Monroe000db94004c0 kernel: [  906.987487] usb 1-5: new high-speed USB device number 45 using ehci-pci
Dec 13 09:40:36 Monroe000db94004c0 kernel: [  907.523454] usb 1-5: device not accepting address 45, error -71
Dec 13 09:40:36 Monroe000db94004c0 kernel: [  907.927424] usb 4-5: new full-speed USB device number 14 using ohci-pci
Dec 13 09:40:36 Monroe000db94004c0 kernel: [  908.227496] usb 1-5: new high-speed USB device number 47 using ehci-pci
Dec 13 09:40:37 Monroe000db94004c0 kernel: [  908.471385] usb 4-5: device not accepting address 14, error -62
alfs commented 7 years ago

Per Kristians request, I removed the mifi's and attached a USB LAN adapter (apple brand) and the USB serial adapter we use for accessing the nodes.

Same problems appear.

Dec 13 10:15:56 Monroe000db94004c0 kernel: [    8.869646] r8169 0000:03:00.0 eth2: unable to load firmware patch rtl_nic/rtl8168e-2.fw (-2)
Dec 13 10:15:56 Monroe000db94004c0 kernel: [    8.885391] r8169 0000:03:00.0 eth2: link down
Dec 13 10:15:56 Monroe000db94004c0 kernel: [    8.885557] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready
Dec 13 10:15:56 Monroe000db94004c0 kernel: [    9.097948] ip_tables: (C) 2000-2006 Netfilter Core Team
Dec 13 10:15:56 Monroe000db94004c0 kernel: [    9.229337] nf_conntrack version 0.5.0 (16384 buckets, 65536 max)
Dec 13 10:15:57 Monroe000db94004c0 kernel: [    9.593833] usb 1-5: USB disconnect, device number 2
Dec 13 10:15:57 Monroe000db94004c0 kernel: [    9.593849] usb 1-5.2: USB disconnect, device number 3
Dec 13 10:15:57 Monroe000db94004c0 kernel: [    9.594247] pl2303 ttyUSB3: pl2303 converter now disconnected from ttyUSB3
Dec 13 10:15:57 Monroe000db94004c0 kernel: [    9.594282] pl2303 1-5.2:1.0: device disconnected
Dec 13 10:15:57 Monroe000db94004c0 kernel: [    9.594542] usb 1-5.3: USB disconnect, device number 4
Dec 13 10:15:57 Monroe000db94004c0 kernel: [    9.594687] asix 1-5.3:1.0 eth3: unregister 'asix' usb-0000:00:12.2-5.3, ASIX AX88772 USB 2.0 Ethernet
Dec 13 10:15:57 Monroe000db94004c0 kernel: [    9.609816] usb 1-5.4: USB disconnect, device number 5
Dec 13 10:15:57 Monroe000db94004c0 kernel: [    9.853332] usb 1-5: new high-speed USB device number 6 using ehci-pci
Dec 13 10:15:57 Monroe000db94004c0 kernel: [   10.185966] ip6_tables: (C) 2000-2006 Netfilter Core Team
Dec 13 10:15:57 Monroe000db94004c0 kernel: [   10.254689] usb 4-5: new full-speed USB device number 2 using ohci-pci
Dec 13 10:15:57 Monroe000db94004c0 kernel: [   10.294640] Netfilter messages via NETLINK v0.30.
Dec 13 10:15:57 Monroe000db94004c0 kernel: [   10.301976] nfnl_acct: registering with nfnetlink.
Dec 13 10:15:57 Monroe000db94004c0 kernel: [   10.326080] ip_set: protocol 6
Dec 13 10:15:57 Monroe000db94004c0 kernel: [   10.416007] usb 4-5: not running at top speed; connect to a high speed hub
Dec 13 10:15:57 Monroe000db94004c0 kernel: [   10.420087] usb 4-5: New USB device found, idVendor=0424, idProduct=2514
Dec 13 10:15:57 Monroe000db94004c0 kernel: [   10.420103] usb 4-5: New USB device strings: Mfr=0, Product=0, SerialNumber=0
Dec 13 10:15:57 Monroe000db94004c0 kernel: [   10.424542] hub 4-5:1.0: USB hub found
Dec 13 10:15:57 Monroe000db94004c0 kernel: [   10.425464] hub 4-5:1.0: 4 ports detected
Dec 13 10:15:57 Monroe000db94004c0 kernel: [   10.462248] ctnetlink v0.93: registering with nfnetlink.
Dec 13 10:15:58 Monroe000db94004c0 kernel: [   10.531063] usb 4-5: USB disconnect, device number 2
Dec 13 10:15:58 Monroe000db94004c0 kernel: [   10.745245] usb 1-5: new high-speed USB device number 7 using ehci-pci
Dec 13 10:15:58 Monroe000db94004c0 kernel: [   11.141426] usb 4-5: new full-speed USB device number 3 using ohci-pci
Dec 13 10:15:58 Monroe000db94004c0 kernel: [   11.299724] usb 4-5: not running at top speed; connect to a high speed hub
Dec 13 10:15:58 Monroe000db94004c0 kernel: [   11.304235] usb 4-5: New USB device found, idVendor=0424, idProduct=2514
Dec 13 10:15:58 Monroe000db94004c0 kernel: [   11.304252] usb 4-5: New USB device strings: Mfr=0, Product=0, SerialNumber=0
Dec 13 10:15:58 Monroe000db94004c0 kernel: [   11.307799] hub 4-5:1.0: USB hub found
Dec 13 10:15:58 Monroe000db94004c0 kernel: [   11.309496] hub 4-5:1.0: 4 ports detected
Dec 13 10:15:59 Monroe000db94004c0 kernel: [   11.617378] usb 4-5.2: new full-speed USB device number 4 using ohci-pci
Dec 13 10:15:59 Monroe000db94004c0 kernel: [   11.736505] usb 4-5.2: New USB device found, idVendor=067b, idProduct=2303
Dec 13 10:15:59 Monroe000db94004c0 kernel: [   11.736522] usb 4-5.2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
Dec 13 10:15:59 Monroe000db94004c0 kernel: [   11.736530] usb 4-5.2: Product: USB-Serial Controller
Dec 13 10:15:59 Monroe000db94004c0 kernel: [   11.736538] usb 4-5.2: Manufacturer: Prolific Technology Inc.
Dec 13 10:15:59 Monroe000db94004c0 kernel: [   11.738862] pl2303 4-5.2:1.0: pl2303 converter detected
Dec 13 10:15:59 Monroe000db94004c0 kernel: [   11.760864] usb 4-5.2: pl2303 converter now attached to ttyUSB3
Dec 13 10:15:59 Monroe000db94004c0 kernel: [   11.853371] usb 4-5.3: new full-speed USB device number 5 using ohci-pci
Dec 13 10:15:59 Monroe000db94004c0 kernel: [   11.966724] usb 4-5.3: not running at top speed; connect to a high speed hub
Dec 13 10:15:59 Monroe000db94004c0 kernel: [   11.991744] usb 4-5.3: New USB device found, idVendor=05ac, idProduct=1402
Dec 13 10:15:59 Monroe000db94004c0 kernel: [   11.991760] usb 4-5.3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
Dec 13 10:15:59 Monroe000db94004c0 kernel: [   11.991770] usb 4-5.3: Product: Apple USB Ethernet Adapter
Dec 13 10:15:59 Monroe000db94004c0 kernel: [   11.991777] usb 4-5.3: Manufacturer: Apple Inc.
Dec 13 10:15:59 Monroe000db94004c0 kernel: [   11.991784] usb 4-5.3: SerialNumber: 36C0B3
Dec 13 10:16:00 Monroe000db94004c0 kernel: [   12.853254] asix 4-5.3:1.0 eth3: register 'asix' at usb-0000:00:12.0-5.3, ASIX AX88772 USB 2.0 Ethernet, 04:69:f8:00:13:37
Dec 13 10:16:00 Monroe000db94004c0 kernel: [   12.945121] usb 4-5.4: new full-speed USB device number 6 using ohci-pci
Dec 13 10:16:00 Monroe000db94004c0 kernel: [   13.003489] asix 4-5.3:1.0 eth3: link down
Dec 13 10:16:00 Monroe000db94004c0 kernel: [   13.024001] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready
Dec 13 10:16:00 Monroe000db94004c0 kernel: [   13.071491] usb 4-5.4: New USB device found, idVendor=04d8, idProduct=f2f7
Dec 13 10:16:00 Monroe000db94004c0 kernel: [   13.071507] usb 4-5.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
Dec 13 10:16:00 Monroe000db94004c0 kernel: [   13.071516] usb 4-5.4: Product: YKUSH
Dec 13 10:16:00 Monroe000db94004c0 kernel: [   13.071523] usb 4-5.4: Manufacturer: Yepkit Lda.
Dec 13 10:16:00 Monroe000db94004c0 kernel: [   13.071531] usb 4-5.4: SerialNumber: YK21434
Dec 13 10:16:01 Monroe000db94004c0 kernel: [   14.403353] r8169 0000:03:00.0 eth2: link up
Dec 13 10:16:01 Monroe000db94004c0 kernel: [   14.403400] IPv6: ADDRCONF(NETDEV_CHANGE): eth2: link becomes ready
Dec 13 10:16:01 Monroe000db94004c0 kernel: [   14.432780] IPv6: ADDRCONF(NETDEV_CHANGE): eth3: link becomes ready
Dec 13 10:16:01 Monroe000db94004c0 kernel: [   14.444538] asix 4-5.3:1.0 eth3: link up, 100Mbps, full-duplex, lpa 0xCDE1
Dec 13 10:16:17 Monroe000db94004c0 kernel: [   30.466923] usb 4-5: USB disconnect, device number 3
Dec 13 10:16:17 Monroe000db94004c0 kernel: [   30.466938] usb 4-5.2: USB disconnect, device number 4
Dec 13 10:16:17 Monroe000db94004c0 kernel: [   30.467454] pl2303 ttyUSB3: pl2303 converter now disconnected from ttyUSB3
Dec 13 10:16:17 Monroe000db94004c0 kernel: [   30.467564] pl2303 4-5.2:1.0: device disconnected
alfs commented 7 years ago

Yepkit hub had errors even without modems attached. Sent to manufacturer for investigation.

Two modems are now directly attached to the APU USB ports to see if they are stable.

alfs commented 7 years ago

After 4 days of uptime, there are two modem disconnect events.

monroe@Monroe000db94004c0:~$ uptime
 08:22:05 up 4 days, 10:31,  1 user,  load average: 0.41, 0.50, 0.53
monroe@Monroe000db94004c0:~$ dmesg | grep -C 2 disconnect
[    9.159507] ip_set: protocol 6
[    9.274376] ctnetlink v0.93: registering with nfnetlink.
[   13.605722] usb 1-1: USB disconnect, device number 2
[   13.877342] usb 1-1: new high-speed USB device number 4 using ehci-pci
[   14.022441] usb 1-1: New USB device found, idVendor=19d2, idProduct=1408
--
[   14.022471] usb 1-1: Manufacturer: ZTE,Incorporated
[   14.022477] usb 1-1: SerialNumber: P680A1ZTED000000
[   14.034178] usb 1-5: USB disconnect, device number 3
[   14.041674] cdc_ether: module verification failed: signature and/or required key missing - tainting kernel
[   14.047131] cdc_ether 1-1:1.0 usb0: register 'cdc_ether' at usb-0000:00:12.2-1, ZTE CDC Ethernet Device, 32:8c:a5:ad:af:ac
--
[   14.425837] cdc_ether 1-5:1.0 usb1: register 'cdc_ether' at usb-0000:00:12.2-5, ZTE CDC Ethernet Device, c2:2d:1c:0b:77:6e
[   14.570206] cdc_ether 1-5:1.0 usb1: kevent 12 may have been dropped
[   22.120189] usb 1-5: USB disconnect, device number 5
[   22.122566] cdc_ether 1-5:1.0 usb1: unregister 'cdc_ether' usb-0000:00:12.2-5, ZTE CDC Ethernet Device
[   22.387969] usb 1-5: new high-speed USB device number 6 using ehci-pci
--
[   24.322797] cdc_ether 1-1:1.0 usb0: kevent 12 may have been dropped
[   25.020698] random: nonblocking pool is initialized
[   29.442497] usb 1-1: USB disconnect, device number 4
[   29.444403] cdc_ether 1-1:1.0 usb0: unregister 'cdc_ether' usb-0000:00:12.2-1, ZTE CDC Ethernet Device
[   29.706954] usb 1-1: new high-speed USB device number 7 using ehci-pci
--
[135388.986686] EXT4-fs (loop4): mounted filesystem with ordered data mode. Opts: (null)
[135391.984585] EXT4-fs (loop5): mounted filesystem with ordered data mode. Opts: (null)
[135646.543337] usb 1-5: USB disconnect, device number 6
[135646.545696] rndis_host 1-5:1.0 usb1: unregister 'rndis_host' usb-0000:00:12.2-5, RNDIS device
[135655.242631] usb 1-5: new high-speed USB device number 8 using ehci-pci
--
[135655.386722] usb 1-5: Manufacturer: ZTE,Incorporated
[135655.386730] usb 1-5: SerialNumber: P680A1ZTED000000
[135661.014876] usb 1-5: USB disconnect, device number 8
[135661.285960] usb 1-5: new high-speed USB device number 9 using ehci-pci
[135661.429781] usb 1-5: New USB device found, idVendor=19d2, idProduct=1408
--
[135661.436545] cdc_ether 1-5:1.0 usb1: register 'cdc_ether' at usb-0000:00:12.2-5, ZTE CDC Ethernet Device, d2:7f:7b:30:29:b4
[135661.599480] cdc_ether 1-5:1.0 usb1: kevent 12 may have been dropped
[135668.983143] usb 1-5: USB disconnect, device number 9
[135668.985483] cdc_ether 1-5:1.0 usb1: unregister 'cdc_ether' usb-0000:00:12.2-5, ZTE CDC Ethernet Device
[135669.287953] usb 1-5: new high-speed USB device number 10 using ehci-pci
--
[138988.543718] EXT4-fs (dm-8): mounted filesystem with ordered data mode. Opts: (null)
[138996.377056] EXT4-fs (dm-9): mounted filesystem with ordered data mode. Opts: (null)
[341657.723589] usb 2-1: USB disconnect, device number 2
[341657.724212] qcserial ttyUSB0: Qualcomm USB modem converter now disconnected from ttyUSB0
[341657.724276] qcserial 2-1:1.0: device disconnected
[341657.724773] qcserial ttyUSB1: Qualcomm USB modem converter now disconnected from ttyUSB1
[341657.724841] qcserial 2-1:1.2: device disconnected
[341657.729045] qcserial ttyUSB2: Qualcomm USB modem converter now disconnected from ttyUSB2
[341657.729106] qcserial 2-1:1.3: device disconnected
[341657.733249] qmi_wwan 2-1:1.8 wwan0: unregister 'qmi_wwan' usb-0000:00:13.2-1, WWAN/QMI device
[341657.767081] qmi_wwan 2-1:1.10 wwan1: unregister 'qmi_wwan' usb-0000:00:13.2-1, WWAN/QMI device
--
[341668.670789] qmi_wwan 2-1:1.10: cdc-wdm1: USB WDM device
[341668.671500] qmi_wwan 2-1:1.10 wwan1: register 'qmi_wwan' at usb-0000:00:13.2-1, WWAN/QMI device, 22:e6:52:bf:38:40
[341673.930026] usb 2-1: USB disconnect, device number 3
[341673.930545] qcserial ttyUSB0: Qualcomm USB modem converter now disconnected from ttyUSB0
[341673.930609] qcserial 2-1:1.0: device disconnected
[341673.933530] qcserial ttyUSB1: Qualcomm USB modem converter now disconnected from ttyUSB1
[341673.933608] qcserial 2-1:1.2: device disconnected
[341673.936920] qcserial ttyUSB2: Qualcomm USB modem converter now disconnected from ttyUSB2
[341673.936970] qcserial 2-1:1.3: device disconnected
[341673.937180] qmi_wwan 2-1:1.8 wwan0: unregister 'qmi_wwan' usb-0000:00:13.2-1, WWAN/QMI device
[341673.955897] qmi_wwan 2-1:1.10 wwan1: unregister 'qmi_wwan' usb-0000:00:13.2-1, WWAN/QMI device
monroe@Monroe000db94004c0:~$ 
jonakarl commented 6 years ago

Not relevant after retiring the mifis and big "node rebuild".