kamermans / docker-openmanage

Dell OpenManage Server Administrator in a Docker container with SNMP support
57 stars 13 forks source link

iDRAC-Upgrade fails with "Failed to access Virtual USB Device", BIOS-Upgrade fails with "Internal Error: ErrorCode not Found in ErrorCodes File" on a R620 #4

Closed maltris closed 7 years ago

maltris commented 7 years ago

Hello and thanks for the great work,

I tested this on a Debian Jessie R620 for now, with the following results:

All firmware got updated except:

Those two updates are not running properly and the following error-messages appear:

|-----------Dell System Updates-----------|
[ ] represents 'not selected'
[*] represents 'selected'
[-] represents 'Component already at repository version (can be selected only if -e option is used)'
Choose:  q - Quit without update, c to Commit, <number> - To Select/Deselect, a - Select All, n - Select None 

[-]1 NetXtreme BCM5720 Gigabit Ethernet PCIe (eth0)
Current Version : 20.2.17 same as : 20.2.17

[-]2 NetXtreme BCM5720 Gigabit Ethernet PCIe (eth1)
Current Version : 20.2.17 same as : 20.2.17

[-]3 NetXtreme BCM5720 Gigabit Ethernet PCIe (eth2)
Current Version : 20.2.17 same as : 20.2.17

[-]4 NetXtreme BCM5720 Gigabit Ethernet PCIe (eth3)
Current Version : 20.2.17 same as : 20.2.17

[*]5 BIOS
Current Version : 1.2.6 Upgrade to : 2.5.4

[-]6 Firmware for  - Disk 0 in Backplane 1 of PERC H710P Mini Controller 0  
Current Version : YS0C same as : YS0C

[-]7 12G SEP Firmware 
Current Version : 1.00 same as : 1.00

[*]8  iDRAC
Current Version : 2.10.10.10 Upgrade to : 2.41.40.40

[-]9 PERC H710P Mini Controller 0 Firmware
Current Version : 21.3.4-0001 same as : 21.3.4-0001

Enter your choice : c
Fetching iDRAC-with-Lifecycle-Controller_Firmware_XTPX4_LN_2.41.40.40_A00 ...
Installing iDRAC-with-Lifecycle-Controller_Firmware_XTPX4_LN_2.41.40.40_A00
Collecting inventory...
.
Running validation...

iDRAC

The version of this Update Package is newer than the currently installed version.
Software application name: iDRAC
Package version: 2.41.40.40
Installed version: 2.10.10.10

Executing update...
WARNING: DO NOT STOP THIS PROCESS OR INSTALL OTHER DELL PRODUCTS WHILE UPDATE IS IN PROGRESS.
THESE ACTIONS MAY CAUSE YOUR SYSTEM TO BECOME UNSTABLE!
.....................................................................   USB Device is not found
.....................................................................   USB Device is not found
....................................................................   USB Device is not found
...
Device: iDRAC
  Application: iDRAC
  Failed to access Virtual USB Device

iDRAC-with-Lifecycle-Controller_Firmware_XTPX4_LN_2.41.40.40_A00 could not be installed 
Fetching BIOS_KR1XT_LN_2.5.4 ...
Installing BIOS_KR1XT_LN_2.5.4
Collecting inventory...
.
Running validation...

Server BIOS 12G

The version of this Update Package is newer than the currently installed version.
Software application name: BIOS
Package version: 2.5.4
Installed version: 1.2.6

Executing update...
WARNING: DO NOT STOP THIS PROCESS OR INSTALL OTHER DELL PRODUCTS WHILE UPDATE IS IN PROGRESS.
THESE ACTIONS MAY CAUSE YOUR SYSTEM TO BECOME UNSTABLE!
..........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
Internal Error: ErrorCode not Found in ErrorCodes File

BIOS_KR1XT_LN_2.5.4 could not be installed 
Done! Please run 'dsu --inventory' to check the inventory
Exiting DSU!

I then tried your dell-dset docker image. This results in the same error:

|-----------Dell System Updates-----------|
[ ] represents 'not selected'
[*] represents 'selected'
[-] represents 'Component already at repository version (can be selected only if -e option is used)'
Choose:  q - Quit without update, c to Commit, <number> - To Select/Deselect, a - Select All, n - Select None 

[-]1 NetXtreme BCM5720 Gigabit Ethernet PCIe (eth0)
Current Version : 20.2.17 same as : 20.2.17

[-]2 NetXtreme BCM5720 Gigabit Ethernet PCIe (eth1)
Current Version : 20.2.17 same as : 20.2.17

[-]3 NetXtreme BCM5720 Gigabit Ethernet PCIe (eth2)
Current Version : 20.2.17 same as : 20.2.17

[-]4 NetXtreme BCM5720 Gigabit Ethernet PCIe (eth3)
Current Version : 20.2.17 same as : 20.2.17

[*]5 BIOS
Current Version : 1.2.6 Upgrade to : 2.5.4

[-]6 Firmware for  - Disk 0 in Backplane 1 of PERC H710P Mini Controller 0  
Current Version : YS0C same as : YS0C

[-]7 12G SEP Firmware 
Current Version : 1.00 same as : 1.00

[*]8  iDRAC
Current Version : 2.10.10.10 Upgrade to : 2.41.40.40

[-]9 PERC H710P Mini Controller 0 Firmware
Current Version : 21.3.4-0001 same as : 21.3.4-0001

Enter your choice : c
Fetching iDRAC-with-Lifecycle-Controller_Firmware_XTPX4_LN_2.41.40.40_A00 ...
Installing iDRAC-with-Lifecycle-Controller_Firmware_XTPX4_LN_2.41.40.40_A00
Collecting inventory...
.
Running validation...

iDRAC

The version of this Update Package is newer than the currently installed version.
Software application name: iDRAC
Package version: 2.41.40.40
Installed version: 2.10.10.10

Executing update...
WARNING: DO NOT STOP THIS PROCESS OR INSTALL OTHER DELL PRODUCTS WHILE UPDATE IS IN PROGRESS.
THESE ACTIONS MAY CAUSE YOUR SYSTEM TO BECOME UNSTABLE!
.....................................................................   USB Device is not found
.....................................................................   USB Device is not found
.....................................................................   USB Device is not found
...
Device: iDRAC
  Application: iDRAC
  Failed to access Virtual USB Device

iDRAC-with-Lifecycle-Controller_Firmware_XTPX4_LN_2.41.40.40_A00 could not be installed 
Fetching BIOS_KR1XT_LN_2.5.4 ...
Installing BIOS_KR1XT_LN_2.5.4
Collecting inventory...
.
Running validation...

Server BIOS 12G

The version of this Update Package is newer than the currently installed version.
Software application name: BIOS
Package version: 2.5.4
Installed version: 1.2.6

Executing update...
WARNING: DO NOT STOP THIS PROCESS OR INSTALL OTHER DELL PRODUCTS WHILE UPDATE IS IN PROGRESS.
THESE ACTIONS MAY CAUSE YOUR SYSTEM TO BECOME UNSTABLE!
...............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
Internal Error: ErrorCode not Found in ErrorCodes File

BIOS_KR1XT_LN_2.5.4 could not be installed 
Done! Please run 'dsu --inventory' to check the inventory
Exiting DSU!

Now in native CentOS 7:

# dsu
Dell System Update 1.4
Copyright (C) 2014 Dell Proprietary.
Verifying catalog installation ...
Installing catalog from repository ...
Fetching dsucatalog ...
Reading the catalog ...
Fetching invcol_WF06C_LN64_16.12.200.896_A00 ...
Verifying inventory collector installation ...
Getting System Inventory ...

warning: Inventory collector returned with partial failure.
Determining Applicable Updates ...

|-----------Dell System Updates-----------|
[ ] represents 'not selected'
[*] represents 'selected'
[-] represents 'Component already at repository version (can be selected only if -e option is used)'
Choose:  q - Quit without update, c to Commit, <number> - To Select/Deselect, a - Select All, n - Select None 

[-]1 NetXtreme BCM5720 Gigabit Ethernet PCIe (em1)
Current Version : 20.2.17 same as : 20.2.17

[-]2 NetXtreme BCM5720 Gigabit Ethernet PCIe (em4)
Current Version : 20.2.17 same as : 20.2.17

[-]3 NetXtreme BCM5720 Gigabit Ethernet PCIe (em2)
Current Version : 20.2.17 same as : 20.2.17

[-]4 NetXtreme BCM5720 Gigabit Ethernet PCIe (em3)
Current Version : 20.2.17 same as : 20.2.17

[ ]5 BIOS
Current Version : 1.2.6 Upgrade to : 2.5.4

[-]6 Firmware for  - Disk 0 in Backplane 1 of PERC H710P Mini Controller 0  
Current Version : YS0C same as : YS0C

[ ]7 OS Collector
Current Version : 0 Upgrade to : OSC_1.1

[-]8 12G SEP Firmware 
Current Version : 1.00 same as : 1.00

[ ]9 Enterprise UEFI Diagnostics, 4217A4, 4217.7
Current Version : 4217A4 Upgrade to : 4247A1

[ ]10  iDRAC
Current Version : 2.10.10.10 Upgrade to : 2.41.40.40

[-]11 PERC H710P Mini Controller 0 Firmware
Current Version : 21.3.4-0001 same as : 21.3.4-0001

Enter your choice : a

|-----------Dell System Updates-----------|
[ ] represents 'not selected'
[*] represents 'selected'
[-] represents 'Component already at repository version (can be selected only if -e option is used)'
Choose:  q - Quit without update, c to Commit, <number> - To Select/Deselect, a - Select All, n - Select None 

[-]1 NetXtreme BCM5720 Gigabit Ethernet PCIe (em1)
Current Version : 20.2.17 same as : 20.2.17

[-]2 NetXtreme BCM5720 Gigabit Ethernet PCIe (em4)
Current Version : 20.2.17 same as : 20.2.17

[-]3 NetXtreme BCM5720 Gigabit Ethernet PCIe (em2)
Current Version : 20.2.17 same as : 20.2.17

[-]4 NetXtreme BCM5720 Gigabit Ethernet PCIe (em3)
Current Version : 20.2.17 same as : 20.2.17

[*]5 BIOS
Current Version : 1.2.6 Upgrade to : 2.5.4

[-]6 Firmware for  - Disk 0 in Backplane 1 of PERC H710P Mini Controller 0  
Current Version : YS0C same as : YS0C

[*]7 OS Collector
Current Version : 0 Upgrade to : OSC_1.1

[-]8 12G SEP Firmware 
Current Version : 1.00 same as : 1.00

[*]9 Enterprise UEFI Diagnostics, 4217A4, 4217.7
Current Version : 4217A4 Upgrade to : 4247A1

[*]10  iDRAC
Current Version : 2.10.10.10 Upgrade to : 2.41.40.40

[-]11 PERC H710P Mini Controller 0 Firmware
Current Version : 21.3.4-0001 same as : 21.3.4-0001

Enter your choice : c
Fetching Diagnostics_Application_5W2KP_LN64_OSC_1.1_X10-00 ...
Installing Diagnostics_Application_5W2KP_LN64_OSC_1.1_X10-00
Collecting inventory...
.......
Inventory Failure: USB is not enabled. Please enable USB and try update again

Diagnostics_Application_5W2KP_LN64_OSC_1.1_X10-00 could not be installed 
Fetching Diagnostics_Application_D5TM2_LN_4247A1_4247.2 ...
Installing Diagnostics_Application_D5TM2_LN_4247A1_4247.2
Collecting inventory...
................................................
Running validation...

Enterprise UEFI Diagnostics, 4217A4, 4217.7

The version of this Update Package is newer than the currently installed version.
Software application name: Enterprise UEFI Diagnostics, 4217A4, 4217.7
Package version: 4247A1
Installed version: 4217A4

Executing update...
WARNING: DO NOT STOP THIS PROCESS OR INSTALL OTHER DELL PRODUCTS WHILE UPDATE IS IN PROGRESS.
THESE ACTIONS MAY CAUSE YOUR SYSTEM TO BECOME UNSTABLE!
............................................................................................
The update completed successfully.
Fetching iDRAC-with-Lifecycle-Controller_Firmware_XTPX4_LN_2.41.40.40_A00 ...
Installing iDRAC-with-Lifecycle-Controller_Firmware_XTPX4_LN_2.41.40.40_A00
Collecting inventory...
.
Running validation...

iDRAC

The version of this Update Package is newer than the currently installed version.
Software application name: iDRAC
Package version: 2.41.40.40
Installed version: 2.10.10.10

Executing update...
WARNING: DO NOT STOP THIS PROCESS OR INSTALL OTHER DELL PRODUCTS WHILE UPDATE IS IN PROGRESS.
THESE ACTIONS MAY CAUSE YOUR SYSTEM TO BECOME UNSTABLE!
................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
The update completed successfully.
Fetching BIOS_KR1XT_LN_2.5.4 ...

Installing BIOS_KR1XT_LN_2.5.4
Collecting inventory...
.
Running validation...

Server BIOS 12G

The version of this Update Package is newer than the currently installed version.
Software application name: BIOS
Package version: 2.5.4
Installed version: 1.2.6

Executing update...
WARNING: DO NOT STOP THIS PROCESS OR INSTALL OTHER DELL PRODUCTS WHILE UPDATE IS IN PROGRESS.
THESE ACTIONS MAY CAUSE YOUR SYSTEM TO BECOME UNSTABLE!
........................................................................................
The system should be restarted for the update to take effect.
Please reboot the system for update(s) to take effect
Done! Please run 'dsu --inventory' to check the inventory
Exiting DSU!

Looks good on the native approach. What could be the reason that in docker those two upgrades fail? Since this also happens in the dset-docket, I do not suspect the container or the settings inside the container itself.

kamermans commented 7 years ago

Yes, there must be something preventing the "installation" of a virtual USB device, which is apparently used to do the update. I imagine that in order to transfer data to the iDRAC, they are faking a USB thumbdrive in software, then accessing it from the iDRAC. Not sure how that is working internally, but I'm surprised it doesn't "just work" considering we're sharing the host devices.

kamermans commented 7 years ago

Can you try to run it with this volume mount in the docker-run command?:

-v /dev/bus/usb:/dev/bus/usb

I guess that even though we're in privileged mode, the /dev tree in the container may not reflect the actual hardware, so perhaps we need to mount the host's devices into the container.

(taken from this thread: http://stackoverflow.com/questions/24225647/docker-any-way-to-give-access-to-host-usb-or-serial-device)

kamermans commented 7 years ago

Hi @maltris, I've managed to reproduce your issue on an R620 and get the iDRAC update working, but mounting /dev/bus/usb is not enough. When the update runs, it connects multiple virtual USB devices to the system: storage, network and a hub. If you mount the entire /dev folder from the host is seems to work fine, although it's not ideal since that includes things like the host's /dev/log, so you will see yum stuff in your ubuntu log :P. Please give it a spin with -v /dev:/dev as it worked for me.

Here is the output of the dsu:

root@hostname:~# docker run --rm -ti --privileged --net="host" -v /dev:/dev kamermans/docker-openmanage bash
[root@hostname bin]# dsu
Dell System Update 1.4
Copyright (C) 2014 Dell Proprietary.
Verifying catalog installation ...
Installing catalog from repository ...
Fetching dsucatalog ...
Reading the catalog ...
Fetching invcol_WF06C_LN64_16.12.200.896_A00 ...
Verifying inventory collector installation ...
Getting System Inventory ...
warning: Inventory collector returned with partial failure.
Determining Applicable Updates ...

|-----------Dell System Updates-----------|
[ ] represents 'not selected'
[*] represents 'selected'
[-] represents 'Component already at repository version (can be selected only if -e option is used)'
Choose:  q - Quit without update, c to Commit, <number> - To Select/Deselect, a - Select All, n - Select None 

[-]1 NetXtreme BCM5720 Gigabit Ethernet PCIe (em3)
Current Version : 20.2.17 same as : 20.2.17

[-]2 NetXtreme BCM5720 Gigabit Ethernet PCIe (em1)
Current Version : 20.2.17 same as : 20.2.17

[-]3 NetXtreme BCM5720 Gigabit Ethernet PCIe (em4)
Current Version : 20.2.17 same as : 20.2.17

[-]4 NetXtreme BCM5720 Gigabit Ethernet PCIe (em2)
Current Version : 20.2.17 same as : 20.2.17

[ ]5 BIOS
Current Version : 2.4.3 Upgrade to : 2.5.4

[-]6 12G SEP Firmware 
Current Version : 1.00 same as : 1.00

[ ]7  iDRAC
Current Version : 2.20.20.20 Upgrade to : 2.41.40.40

[ ]8 PERC H710P Mini Controller 0 Firmware
Current Version : 21.3.2-0005 Upgrade to : 21.3.4-0001

Enter your choice : 7

|-----------Dell System Updates-----------|
[ ] represents 'not selected'
[*] represents 'selected'
[-] represents 'Component already at repository version (can be selected only if -e option is used)'
Choose:  q - Quit without update, c to Commit, <number> - To Select/Deselect, a - Select All, n - Select None 

[-]1 NetXtreme BCM5720 Gigabit Ethernet PCIe (em3)
Current Version : 20.2.17 same as : 20.2.17

[-]2 NetXtreme BCM5720 Gigabit Ethernet PCIe (em1)
Current Version : 20.2.17 same as : 20.2.17

[-]3 NetXtreme BCM5720 Gigabit Ethernet PCIe (em4)
Current Version : 20.2.17 same as : 20.2.17

[-]4 NetXtreme BCM5720 Gigabit Ethernet PCIe (em2)
Current Version : 20.2.17 same as : 20.2.17

[ ]5 BIOS
Current Version : 2.4.3 Upgrade to : 2.5.4

[-]6 12G SEP Firmware 
Current Version : 1.00 same as : 1.00

[*]7  iDRAC
Current Version : 2.20.20.20 Upgrade to : 2.41.40.40

[ ]8 PERC H710P Mini Controller 0 Firmware
Current Version : 21.3.2-0005 Upgrade to : 21.3.4-0001

Enter your choice : c
Fetching iDRAC-with-Lifecycle-Controller_Firmware_XTPX4_LN_2.41.40.40_A00 ...
Installing iDRAC-with-Lifecycle-Controller_Firmware_XTPX4_LN_2.41.40.40_A00
Collecting inventory...
.
Running validation...

iDRAC

The version of this Update Package is newer than the currently installed version.
Software application name: iDRAC
Package version: 2.41.40.40
Installed version: 2.20.20.20

Executing update...
WARNING: DO NOT STOP THIS PROCESS OR INSTALL OTHER DELL PRODUCTS WHILE UPDATE IS IN PROGRESS.
THESE ACTIONS MAY CAUSE YOUR SYSTEM TO BECOME UNSTABLE!
....................................................................   USB Device is not found
..................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
The update completed successfully.
Done! Please run 'dsu --inventory' to check the inventory
Exiting DSU!

and syslog on the host:

# During initialization "Getting System Inventory ..."
Mar  8 12:28:22 hostname kernel: [15115928.746860] usb 1-1.6.2: USB disconnect, device number 10
Mar  8 12:28:25 hostname kernel: [15115932.209576] usb 1-1.6.2: new high-speed USB device number 11 using ehci-pci
Mar  8 12:28:25 hostname kernel: [15115932.326555] usb 1-1.6.2: New USB device found, idVendor=0624, idProduct=0250
Mar  8 12:28:25 hostname kernel: [15115932.326558] usb 1-1.6.2: New USB device strings: Mfr=4, Product=5, SerialNumber=6
Mar  8 12:28:25 hostname kernel: [15115932.326559] usb 1-1.6.2: Product: Mass Storage Function
Mar  8 12:28:25 hostname kernel: [15115932.326560] usb 1-1.6.2: Manufacturer: Avocent
Mar  8 12:28:25 hostname kernel: [15115932.326562] usb 1-1.6.2: SerialNumber: 20120731
Mar  8 12:28:25 hostname kernel: [15115932.327339] usb-storage 1-1.6.2:1.0: USB Mass Storage device detected
Mar  8 12:28:25 hostname kernel: [15115932.327653] scsi host6: usb-storage 1-1.6.2:1.0
Mar  8 12:28:26 hostname kernel: [15115933.327488] scsi 6:0:0:0: Direct-Access     iDRAC    SECUPD           0329 PQ: 0 ANSI: 0 CCS
Mar  8 12:28:26 hostname kernel: [15115933.327820] sd 6:0:0:0: Attached scsi generic sg3 type 0
Mar  8 12:28:26 hostname kernel: [15115933.329106] sd 6:0:0:0: [sdd] 2112 512-byte logical blocks: (1.08 MB/1.03 MiB)
Mar  8 12:28:26 hostname kernel: [15115933.330148] sd 6:0:0:0: [sdd] Write Protect is off
Mar  8 12:28:26 hostname kernel: [15115933.330152] sd 6:0:0:0: [sdd] Mode Sense: 23 00 00 00
Mar  8 12:28:26 hostname kernel: [15115933.331204] sd 6:0:0:0: [sdd] No Caching mode page found
Mar  8 12:28:26 hostname kernel: [15115933.332883] sd 6:0:0:0: [sdd] Assuming drive cache: write through
Mar  8 12:28:26 hostname kernel: [15115933.449055]  sdd:
Mar  8 12:28:27 hostname kernel: [15115933.690246] sd 6:0:0:0: [sdd] Attached SCSI removable disk
Mar  8 12:33:28 hostname kernel: [15116234.971584] audit: type=1400 audit(1488994408.310:42557): apparmor="ALLOWED" operation="open" profile="/usr/sbin/sssd" name="/var/lib/sss/pubconf/krb5.include.d/" pid=5407 comm="ldap_child" requested_mask="r" denied_mask="r" fsuid=0 ouid=0
Mar  8 12:33:28 hostname kernel: [15116234.971609] audit: type=1400 audit(1488994408.310:42558): apparmor="ALLOWED" operation="open" profile="/usr/sbin/sssd" name="/var/lib/sss/pubconf/krb5.include.d/domain_realm_scientiamobile_local" pid=5407 comm="ldap_child" requested_mask="r" denied_mask="r" fsuid=0 ouid=0
Mar  8 12:33:29 hostname kernel: [15116235.987513] sdd: detected capacity change from 1081344 to 0
Mar  8 12:33:29 hostname kernel: [15116236.139439] usb 1-1.6.2: USB disconnect, device number 11
Mar  8 12:33:32 hostname kernel: [15116239.515759] usb 1-1.6.2: new high-speed USB device number 12 using ehci-pci
Mar  8 12:33:32 hostname kernel: [15116239.632919] usb 1-1.6.2: New USB device found, idVendor=0624, idProduct=0250
Mar  8 12:33:32 hostname kernel: [15116239.632923] usb 1-1.6.2: New USB device strings: Mfr=4, Product=5, SerialNumber=6
Mar  8 12:33:32 hostname kernel: [15116239.632924] usb 1-1.6.2: Product: Mass Storage Function
Mar  8 12:33:32 hostname kernel: [15116239.632926] usb 1-1.6.2: Manufacturer: Avocent
Mar  8 12:33:32 hostname kernel: [15116239.632927] usb 1-1.6.2: SerialNumber: 20120731
Mar  8 12:33:32 hostname kernel: [15116239.634489] usb-storage 1-1.6.2:1.0: USB Mass Storage device detected
Mar  8 12:33:32 hostname kernel: [15116239.634888] scsi host7: usb-storage 1-1.6.2:1.0
Mar  8 12:33:33 hostname kernel: [15116240.632991] scsi 7:0:0:0: Direct-Access     iDRAC    SECUPD           0329 PQ: 0 ANSI: 0 CCS
Mar  8 12:33:33 hostname kernel: [15116240.633419] sd 7:0:0:0: Attached scsi generic sg3 type 0
Mar  8 12:33:33 hostname kernel: [15116240.634594] sd 7:0:0:0: [sdd] 2112 512-byte logical blocks: (1.08 MB/1.03 MiB)
Mar  8 12:33:34 hostname kernel: [15116240.740792] sd 7:0:0:0: [sdd] Write Protect is off
Mar  8 12:33:34 hostname kernel: [15116240.740797] sd 7:0:0:0: [sdd] Mode Sense: 23 00 00 00
Mar  8 12:33:34 hostname kernel: [15116240.850965] sd 7:0:0:0: [sdd] No Caching mode page found
Mar  8 12:33:34 hostname kernel: [15116240.852654] sd 7:0:0:0: [sdd] Assuming drive cache: write through
Mar  8 12:33:34 hostname kernel: [15116240.963196]  sdd:
Mar  8 12:33:34 hostname kernel: [15116241.094908] sd 7:0:0:0: [sdd] Attached SCSI removable disk
Mar  8 12:34:26 hostname kernel: [15116293.604038] aufs au_opts_verify:1597:dockerd[13103]: dirperm1 breaks the protection by the permission bits on the lower branch
Mar  8 12:34:27 hostname kernel: [15116293.734296] aufs au_opts_verify:1597:dockerd[13103]: dirperm1 breaks the protection by the permission bits on the lower branch
Mar  8 12:34:27 hostname kernel: [15116293.891643] aufs au_opts_verify:1597:dockerd[13103]: dirperm1 breaks the protection by the permission bits on the lower branch
Mar  8 12:34:55 hostname yum[32]: Installed: dsucatalog-17.02.00-WF25X.noarch
Mar  8 12:35:00 hostname yum[88]: Installed: invcol_WF06C_LN64_16.12.200.896_A00-16.12.200.896-WF06C.x86_64
Mar  8 12:37:51 hostname instsvcdrv: dell_rbu device driver unload failed for kernel 4.2.0-27-generic

# During BIOS Update
Mar  8 12:37:59 hostname kernel: [15116506.057048] IPv6: ADDRCONF(NETDEV_UP): em4: link is not ready
Mar  8 12:37:59 hostname kernel: [15116506.188152] IPv6: ADDRCONF(NETDEV_UP): em3: link is not ready
Mar  8 12:48:29 hostname kernel: [15117136.385361] audit: type=1400 audit(1488995309.391:42559): apparmor="ALLOWED" operation="open" profile="/usr/sbin/sssd" name="/var/lib/sss/pubconf/krb5.include.d/" pid=11304 comm="ldap_child" requested_mask="r" denied_mask="r" fsuid=0 ouid=0
Mar  8 12:48:29 hostname kernel: [15117136.385386] audit: type=1400 audit(1488995309.391:42560): apparmor="ALLOWED" operation="open" profile="/usr/sbin/sssd" name="/var/lib/sss/pubconf/krb5.include.d/domain_realm_scientiamobile_local" pid=11304 comm="ldap_child" requested_mask="r" denied_mask="r" fsuid=0 ouid=0
Mar  8 12:52:43 hostname yum[2644]: Installed: iDRAC-with-Lifecycle-Controller_Firmware_XTPX4_LN_2.41.40.40_A00-2.41.40.40-17.02.00.noarch
Mar  8 12:52:55 hostname kernel: [15117402.146352] usb 1-1.6.2: USB disconnect, device number 12
Mar  8 12:52:56 hostname kernel: [15117403.540104] usb 1-1.6.2: new high-speed USB device number 13 using ehci-pci
Mar  8 12:52:56 hostname kernel: [15117403.657095] usb 1-1.6.2: New USB device found, idVendor=0624, idProduct=0250
Mar  8 12:52:56 hostname kernel: [15117403.657099] usb 1-1.6.2: New USB device strings: Mfr=4, Product=5, SerialNumber=6
Mar  8 12:52:56 hostname kernel: [15117403.657101] usb 1-1.6.2: Product: Mass Storage Function
Mar  8 12:52:56 hostname kernel: [15117403.657102] usb 1-1.6.2: Manufacturer: Avocent
Mar  8 12:52:56 hostname kernel: [15117403.657103] usb 1-1.6.2: SerialNumber: 20120731
Mar  8 12:52:56 hostname kernel: [15117403.657496] usb-storage 1-1.6.2:1.0: USB Mass Storage device detected
Mar  8 12:52:56 hostname kernel: [15117403.664142] scsi host8: usb-storage 1-1.6.2:1.0
Mar  8 12:52:57 hostname kernel: [15117404.667906] scsi 8:0:0:0: Direct-Access     iDRAC    SECUPD           0329 PQ: 0 ANSI: 0 CCS
Mar  8 12:52:57 hostname kernel: [15117404.669274] scsi 8:0:0:1: Direct-Access     iDRAC    scrtch           0329 PQ: 0 ANSI: 0 CCS
Mar  8 12:52:57 hostname kernel: [15117404.669694] sd 8:0:0:0: Attached scsi generic sg3 type 0
Mar  8 12:52:57 hostname kernel: [15117404.670031] sd 8:0:0:1: Attached scsi generic sg4 type 0
Mar  8 12:52:57 hostname kernel: [15117404.673120] sd 8:0:0:0: [sdd] 2112 512-byte logical blocks: (1.08 MB/1.03 MiB)
Mar  8 12:52:57 hostname kernel: [15117404.673494] sd 8:0:0:1: [sde] 630784 512-byte logical blocks: (322 MB/308 MiB)
Mar  8 12:52:57 hostname kernel: [15117404.777705] sd 8:0:0:0: [sdd] Write Protect is off
Mar  8 12:52:57 hostname kernel: [15117404.777710] sd 8:0:0:0: [sdd] Mode Sense: 23 00 00 00
Mar  8 12:52:57 hostname kernel: [15117404.778814] sd 8:0:0:1: [sde] Write Protect is off
Mar  8 12:52:57 hostname kernel: [15117404.778817] sd 8:0:0:1: [sde] Mode Sense: 23 00 00 00
Mar  8 12:52:58 hostname kernel: [15117404.887414] sd 8:0:0:0: [sdd] No Caching mode page found
Mar  8 12:52:58 hostname kernel: [15117404.890533] sd 8:0:0:1: [sde] No Caching mode page found
Mar  8 12:52:58 hostname kernel: [15117404.890535] sd 8:0:0:1: [sde] Assuming drive cache: write through
Mar  8 12:52:58 hostname kernel: [15117405.108778]  sde:
Mar  8 12:52:58 hostname kernel: [15117405.117024] sd 8:0:0:0: [sdd] Assuming drive cache: write through
Mar  8 12:52:58 hostname kernel: [15117405.337547] sd 8:0:0:1: [sde] Attached SCSI removable disk
Mar  8 12:52:58 hostname kernel: [15117405.454079]  sdd:
Mar  8 12:52:58 hostname kernel: [15117405.677570] sd 8:0:0:0: [sdd] Attached SCSI removable disk
Mar  8 12:53:59 hostname kernel: [15117466.201181] usb 1-1.6.2: USB disconnect, device number 13
Mar  8 12:53:59 hostname kernel: [15117466.207486] sde: detected capacity change from 322961408 to 0
Mar  8 12:54:06 hostname kernel: [15117474.034279] usb 1-1.6.2: new high-speed USB device number 14 using ehci-pci
Mar  8 12:54:07 hostname kernel: [15117474.151433] usb 1-1.6.2: New USB device found, idVendor=0624, idProduct=0250
Mar  8 12:54:07 hostname kernel: [15117474.151435] usb 1-1.6.2: New USB device strings: Mfr=4, Product=5, SerialNumber=6
Mar  8 12:54:07 hostname kernel: [15117474.151437] usb 1-1.6.2: Product: Mass Storage Function
Mar  8 12:54:07 hostname kernel: [15117474.151438] usb 1-1.6.2: Manufacturer: Avocent
Mar  8 12:54:07 hostname kernel: [15117474.151439] usb 1-1.6.2: SerialNumber: 20120731
Mar  8 12:54:07 hostname kernel: [15117474.152597] usb-storage 1-1.6.2:1.0: USB Mass Storage device detected
Mar  8 12:54:07 hostname kernel: [15117474.152938] scsi host9: usb-storage 1-1.6.2:1.0
Mar  8 12:54:08 hostname kernel: [15117475.151471] scsi 9:0:0:0: Direct-Access     iDRAC    scrtch           0329 PQ: 0 ANSI: 0 CCS
Mar  8 12:54:08 hostname kernel: [15117475.151882] sd 9:0:0:0: Attached scsi generic sg3 type 0
Mar  8 12:54:08 hostname kernel: [15117475.153181] sd 9:0:0:0: [sdd] 630784 512-byte logical blocks: (322 MB/308 MiB)
Mar  8 12:54:08 hostname kernel: [15117475.267025] sd 9:0:0:0: [sdd] Write Protect is off
Mar  8 12:54:08 hostname kernel: [15117475.267028] sd 9:0:0:0: [sdd] Mode Sense: 23 00 00 00
Mar  8 12:54:08 hostname kernel: [15117475.268886] sd 9:0:0:0: [sdd] No Caching mode page found
Mar  8 12:54:08 hostname kernel: [15117475.342091] sd 9:0:0:0: [sdd] Assuming drive cache: write through
Mar  8 12:54:08 hostname kernel: [15117475.533237]  sdd:
Mar  8 12:54:08 hostname kernel: [15117475.643288] sd 9:0:0:0: [sdd] Attached SCSI removable disk
Mar  8 12:55:51 hostname kernel: [15117578.420403] usb 1-1.6.2: USB disconnect, device number 14
Mar  8 12:59:30 hostname kernel: [15117797.622564] usb 1-1.6: USB disconnect, device number 4
Mar  8 12:59:30 hostname kernel: [15117797.622568] usb 1-1.6.1: USB disconnect, device number 5
Mar  8 12:59:30 hostname acpid: input device has been disconnected, fd 7
Mar  8 12:59:39 hostname kernel: [15117807.029922] usb 1-1.6: new high-speed USB device number 15 using ehci-pci
Mar  8 12:59:39 hostname kernel: [15117807.122858] usb 1-1.6: New USB device found, idVendor=413c, idProduct=a001
Mar  8 12:59:39 hostname kernel: [15117807.122861] usb 1-1.6: New USB device strings: Mfr=1, Product=2, SerialNumber=3
Mar  8 12:59:39 hostname kernel: [15117807.122862] usb 1-1.6: Product: Gadget USB HUB
Mar  8 12:59:39 hostname kernel: [15117807.122864] usb 1-1.6: Manufacturer: no manufacturer
Mar  8 12:59:39 hostname kernel: [15117807.122865] usb 1-1.6: SerialNumber: 0123456789
Mar  8 12:59:39 hostname kernel: [15117807.123239] hub 1-1.6:1.0: USB hub found
Mar  8 12:59:39 hostname kernel: [15117807.123329] hub 1-1.6:1.0: 6 ports detected
Mar  8 13:00:20 hostname kernel: [15117848.061182] usb 1-1.6.1: new high-speed USB device number 16 using ehci-pci
Mar  8 13:00:20 hostname kernel: [15117848.178110] usb 1-1.6.1: New USB device found, idVendor=0624, idProduct=0249
Mar  8 13:00:20 hostname kernel: [15117848.178114] usb 1-1.6.1: New USB device strings: Mfr=4, Product=5, SerialNumber=6
Mar  8 13:00:20 hostname kernel: [15117848.178115] usb 1-1.6.1: Product: Keyboard/Mouse Function
Mar  8 13:00:20 hostname kernel: [15117848.178117] usb 1-1.6.1: Manufacturer: Avocent
Mar  8 13:00:20 hostname kernel: [15117848.178118] usb 1-1.6.1: SerialNumber: 20121018
Mar  8 13:00:20 hostname kernel: [15117848.179070] input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6.1/1-1.6.1:1.0/0003:0624:0249.0006/input/input6
Mar  8 13:00:20 hostname kernel: [15117848.233624] hid-generic 0003:0624:0249.0006: input,hidraw2: USB HID v1.00 Keyboard [Avocent Keyboard/Mouse Function] on usb-0000:00:1a.0-1.6.1/input0
Mar  8 13:00:20 hostname kernel: [15117848.234498] input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6.1/1-1.6.1:1.1/0003:0624:0249.0007/input/input7
Mar  8 13:00:21 hostname kernel: [15117848.289572] hid-generic 0003:0624:0249.0007: input,hidraw3: USB HID v1.00 Mouse [Avocent Keyboard/Mouse Function] on usb-0000:00:1a.0-1.6.1/input1
Mar  8 13:00:21 hostname kernel: [15117848.290432] input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6.1/1-1.6.1:1.2/0003:0624:0249.0008/input/input8
Mar  8 13:00:21 hostname kernel: [15117848.290649] hid-generic 0003:0624:0249.0008: input,hidraw4: USB HID v1.00 Mouse [Avocent Keyboard/Mouse Function] on usb-0000:00:1a.0-1.6.1/input2
Mar  8 13:00:21 hostname kernel: [15117849.237612] usb 1-1.6.3: new high-speed USB device number 17 using ehci-pci
Mar  8 13:00:22 hostname kernel: [15117849.354945] usb 1-1.6.3: New USB device found, idVendor=413c, idProduct=a102
Mar  8 13:00:22 hostname kernel: [15117849.354949] usb 1-1.6.3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
Mar  8 13:00:22 hostname kernel: [15117849.354950] usb 1-1.6.3: Product: iDRAC Virtual NIC USB Device
Mar  8 13:00:22 hostname kernel: [15117849.354952] usb 1-1.6.3: Manufacturer: Dell(TM)
Mar  8 13:00:22 hostname kernel: [15117849.371317] cdc_ether 1-1.6.3:1.0 usb0: register 'cdc_ether' at usb-0000:00:1a.0-1.6.3, CDC Ethernet Device, 7a:c0:3f:b5:13:ff
Mar  8 13:00:22 hostname kernel: [15117849.371343] usbcore: registered new interface driver cdc_ether
Mar  8 13:00:22 hostname kernel: [15117849.373036] cdc_ether 1-1.6.3:1.0 idrac: renamed from usb0
Mar  8 13:00:22 hostname kernel: [15117849.549995] systemd-udevd[15369]: renamed network interface usb0 to idrac
Mar  8 13:00:26 hostname kernel: [15117853.625116] usb 1-1.6.3: USB disconnect, device number 17
Mar  8 13:00:26 hostname kernel: [15117853.625155] cdc_ether 1-1.6.3:1.0 idrac: unregister 'cdc_ether' usb-0000:00:1a.0-1.6.3, CDC Ethernet Device
Mar  8 13:00:44 hostname kernel: [15117871.934229] usb 1-1.6.1: USB disconnect, device number 16
Mar  8 13:00:46 hostname kernel: [15117874.106828] usb 1-1.6.1: new high-speed USB device number 18 using ehci-pci
Mar  8 13:00:46 hostname kernel: [15117874.224272] usb 1-1.6.1: New USB device found, idVendor=0624, idProduct=0249
Mar  8 13:00:46 hostname kernel: [15117874.224276] usb 1-1.6.1: New USB device strings: Mfr=4, Product=5, SerialNumber=6
Mar  8 13:00:46 hostname kernel: [15117874.224277] usb 1-1.6.1: Product: Keyboard/Mouse Function
Mar  8 13:00:46 hostname kernel: [15117874.224279] usb 1-1.6.1: Manufacturer: Avocent
Mar  8 13:00:46 hostname kernel: [15117874.224280] usb 1-1.6.1: SerialNumber: 20121018
Mar  8 13:00:46 hostname kernel: [15117874.225339] input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6.1/1-1.6.1:1.0/0003:0624:0249.0009/input/input9
Mar  8 13:00:47 hostname kernel: [15117874.279360] hid-generic 0003:0624:0249.0009: input,hidraw2: USB HID v1.00 Keyboard [Avocent Keyboard/Mouse Function] on usb-0000:00:1a.0-1.6.1/input0
Mar  8 13:00:47 hostname kernel: [15117874.280215] input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6.1/1-1.6.1:1.1/0003:0624:0249.000A/input/input10
Mar  8 13:00:47 hostname kernel: [15117874.335468] hid-generic 0003:0624:0249.000A: input,hidraw3: USB HID v1.00 Mouse [Avocent Keyboard/Mouse Function] on usb-0000:00:1a.0-1.6.1/input1
Mar  8 13:00:47 hostname kernel: [15117874.336518] input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6.1/1-1.6.1:1.2/0003:0624:0249.000B/input/input11
Mar  8 13:00:47 hostname kernel: [15117874.336843] hid-generic 0003:0624:0249.000B: input,hidraw4: USB HID v1.00 Mouse [Avocent Keyboard/Mouse Function] on usb-0000:00:1a.0-1.6.1/input2
Mar  8 13:02:54 hostname spsetup.sh: Package Release ID=XTPX4A00 Package Description=IDRAC with Lifecycle Controller V.,2.41.40.40, A00 Exit code = 0 (Success)
Mar  8 13:02:54 hostname logger: Update Package: iDRAC with Lifecycle Controller Firmware: Exit code = 0 (Success) Support Log path=/var/log/dell/updatepackage/log/support/iDRAC-with-Lifecycle-Controller_Firmware_XTPX4_LN_2.41.40.40_A00.log
Mar  8 13:02:56 hostname yum[5960]: Erased: iDRAC-with-Lifecycle-Controller_Firmware_XTPX4_LN_2.41.40.40_A00-2.41.40.40-17.02.00.noarch
kamermans commented 7 years ago

Good news: the BIOS update also worked:

|-----------Dell System Updates-----------|
[ ] represents 'not selected'
[*] represents 'selected'
[-] represents 'Component already at repository version (can be selected only if -e option is used)'
Choose:  q - Quit without update, c to Commit, <number> - To Select/Deselect, a - Select All, n - Select None 

[-]1 NetXtreme BCM5720 Gigabit Ethernet PCIe (em3)
Current Version : 20.2.17 same as : 20.2.17

[-]2 NetXtreme BCM5720 Gigabit Ethernet PCIe (em1)
Current Version : 20.2.17 same as : 20.2.17

[-]3 NetXtreme BCM5720 Gigabit Ethernet PCIe (em4)
Current Version : 20.2.17 same as : 20.2.17

[-]4 NetXtreme BCM5720 Gigabit Ethernet PCIe (em2)
Current Version : 20.2.17 same as : 20.2.17

[*]5 BIOS
Current Version : 2.4.3 Upgrade to : 2.5.4

[-]6 12G SEP Firmware 
Current Version : 1.00 same as : 1.00

[ ]7 OS Collector
Current Version : 0 Upgrade to : OSC_1.1

[ ]8 Enterprise UEFI Diagnostics, 4217A4, 4217.7
Current Version : 4217A4 Upgrade to : 4247A1

[-]9  iDRAC
Current Version : 2.41.40.40 same as : 2.41.40.40

[ ]10 PERC H710P Mini Controller 0 Firmware
Current Version : 21.3.2-0005 Upgrade to : 21.3.4-0001

Enter your choice : c
Fetching BIOS_KR1XT_LN_2.5.4 ...
Installing BIOS_KR1XT_LN_2.5.4
Collecting inventory...
.
Running validation...

Server BIOS 12G

The version of this Update Package is newer than the currently installed version.
Software application name: BIOS
Package version: 2.5.4
Installed version: 2.4.3

Executing update...
WARNING: DO NOT STOP THIS PROCESS OR INSTALL OTHER DELL PRODUCTS WHILE UPDATE IS IN PROGRESS.
THESE ACTIONS MAY CAUSE YOUR SYSTEM TO BECOME UNSTABLE!
.........................................................................................................
The system should be restarted for the update to take effect.
Please reboot the system for update(s) to take effect
Done! Please run 'dsu --inventory' to check the inventory
Exiting DSU!
maltris commented 7 years ago

This resolved the problem, the BIOS gets updated properly.

Although now, that all the inventory is recognized, I experienced a different problem with the "Diagnostics application" - but I will open a different issue for that after investigating further.

srstsavage commented 4 years ago

I was hitting the USB is not enabled. Please enable USB and try update again error because the usb-storage module wasn't loaded.

lsmod | grep usb-storage

To load:

modprobe usb-storage

Or to make persistent:

echo usb-storage > /etc/modules-load.d/usb-storage.conf
kamermans commented 4 years ago

Thanks, that's a great tip @shane-axiom!