search

Aquantia / AQtion-esxi

Aquantia AQC10x multigigabit PCIe NIC linux driver (atlantic) - VmWare ESXi port
https://github.com/Aquantia/AQtion-esxi/releases
59 stars 13 forks source link

Doesn't work with ESXi 7.0 or 7.0b #18

Closed mack42 closed 4 years ago

mack42 commented 4 years ago

Hi, please provide a working driver for ESX 7.x.

All I see is the log when trying to install the VIB: esxcli software vib install -v /vmfs/volumes/1TB-02/net670-atlantic -v2.2.3.0-esxi1.6.x86_x64.vib [DependencyError] VIB Aquantia_bootbank_net-atlantic_v2.2.3.0-esxi1.6 requires vmkapi_2_3_0_0, but the requirement cannot be satisfied within the ImageProfile. Please refer to the log file for more details.

emonjoin commented 4 years ago

https://my.vmware.com/en/web/vmware/downloads/details?downloadGroup=DT-ESXI67-MARVELL-ATLANTIC-1020&productId=742

Works perfectly on ESXi 7.0b

0dragosh commented 4 years ago

@emonjoin I get this error:

root@nuc1:/nic_driver] esxcli software component apply -d /nic_driver/MRVL-Atlantic-Driver-Bundle_1.0.2.0-1OEM.670.0.0.816992
2-offline-bundle-16081713.zip
 [DependencyError]
 Component MRVL-Atlantic-Driver-Bundle_1.0.2.0-1OEM.670.0.0.8169922 has unmet dependency vmkapi_2_5_0_0 that is not provided by any component in depot.
 Please refer to the log file for more details.

Any clues as to how I can solve it? Running esxi 7.0b on an Intel Nuc 10th gen.

Really interested on how you got this to install on 7.0b. I'm pretty sure we just need an updated driver.

Edit: NVM. Figured it out. You have to force install:

esxcli software vib install -f -d /nic_driver/net670-atlantic-v2.2.3.0-esxi1.6.x86_x64-offline-bundle.zip

Also set vib acceptance level to community:

esxcli software acceptance set --level=CommunitySupported

Now my problem is the driver doesn't actually work. I can't see the NIC in the physical adapters list 😢

@cail @dimbez any ideas whatsoever as to why it wouldn't work? also can we expect an update since it's been more 15 months since the last release?

dimbez commented 4 years ago

Hello @0dragosh, Due to native driver released, please don't use net670-atlantic-v2.2.3.0-esxi1.6.x86_x64-offline-bundle.zip, It's linux based driver and it's not more supported by ESXi7.0 and higher. According your error: I'd like to aware you that this .zip file is not component, it's an offline bundle, so please use the following command line to install it: esxcli software vib install -d /nic_driver/MRVL-Atlantic-Driver-Bundle_1.0.2.0-1OEM.670.0.0.816992 2-offline-bundle-16081713.zip

dimbez commented 4 years ago

@mack42 Please use the following link to download driver: https://www.vmware.com/resources/compatibility/search.php?deviceCategory=io&details=1&releases=448&VID=1d6a&page=1&display_interval=10&sortColumn=Partner&sortOrder=Asc

0dragosh commented 4 years ago

Hi @dimbez , thanks for the fast reply!

I've installed the 6.7 vib as per your download link and instructions, but I still can't see the NIC (and yes, I did reboot). It's a Sonnet Solo10G thunderbolt 3 to ethernet adapter with the AQC-107S chip.

I'm running this on an Intel NUC10i7FNK2:

[root@nuc1:~] esxcli system version get
   Product: VMware ESXi
   Version: 7.0.0
   Build: Releasebuild-16324942
   Update: 0
   Patch: 25

I've run this on 2 identical nucs with 2 identical Solo10Gs and I get the same result.

dimbez commented 4 years ago

@0dragosh, is your thunderbold device listed in lspci ?

0dragosh commented 4 years ago

@dimbez no, it is not. only in lsusb. lspci:

[root@nuc1:~] lspci
0000:00:00.0 Host bridge: Intel Corporation Device 9b51
0000:00:02.0 VGA compatible controller: Intel Corporation Device 9bca
0000:00:08.0 System peripheral: Intel Corporation Xeon E3-1200 v5/v6 / E3-1500 v5 / 6th/7th/8th Gen Core Processor Gaussian Mixture Model
0000:00:12.0 Signal processing controller: Intel Corporation Comet Lake Thermal Subsytem
0000:00:14.0 USB controller: Intel Corporation Device 02ed [vmhba32]
0000:00:14.2 RAM memory: Intel Corporation Device 02ef
0000:00:14.3 Network controller: Intel Corporation Wireless-AC 9462
0000:00:15.0 Serial bus controller: Intel Corporation Serial IO I2C Host Controller
0000:00:15.2 Serial bus controller: Intel Corporation Device 02ea
0000:00:16.0 Communication controller: Intel Corporation Comet Lake Management Engine Interface
0000:00:17.0 SATA controller: Intel Corporation Comet Lake SATA AHCI Controller [vmhba0]
0000:00:1c.0 PCI bridge: Intel Corporation Device 02bc [PCIe RP[0000:00:1c.0]]
0000:00:1d.0 PCI bridge: Intel Corporation Device 02b0 [PCIe RP[0000:00:1d.0]]
0000:00:1d.5 PCI bridge: Intel Corporation Device 02b5 [PCIe RP[0000:00:1d.5]]
0000:00:1f.0 ISA bridge: Intel Corporation Device 0284
0000:00:1f.3 Audio device: Intel Corporation Device 02c8
0000:00:1f.4 SMBus: Intel Corporation Device 02a3
0000:00:1f.5 Serial bus controller: Intel Corporation Comet Lake SPI (flash) Controller
0000:00:1f.6 Ethernet controller: Intel Corporation Ethernet Connection (10) I219-V [vmnic0]
0000:3a:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981/PM983 [vmhba1]
0000:3b:00.0 SD Host controller: Genesys Logic, Inc Device 9755

lsusb where the sonnet device (2a8c:0034) does appear:


[root@nuc1:~] lsusb
Bus 001 Device 001: ID 0e0f:8003 VMware, Inc. Root Hub
Bus 001 Device 002: ID 2a8c:0034
Bus 001 Device 003: ID 8087:0026 Intel Corp.
Bus 001 Device 004: ID 0b95:1790 ASIX Electronics Corp. AX88179 Gigabit Ethernet
Bus 001 Device 005: ID 125f:a89a A-DATA Technology Co., Ltd.
Bus 001 Device 006: ID 0781:5583 SanDisk Corp. Ultra Fit```
0dragosh commented 4 years ago

@dimbez also adding the vib description

[root@nuc1:~] esxcli software vib list | grep atl
atlantic                       1.0.2.0-1OEM.670.0.0.8169922        MRVL    VMwareCertified   2020-08-11
dimbez commented 4 years ago

Please make sure your device is connected to thunderbolt port. Due to your adapter is not listed in lspci, it means that issue is not related to driver and it's related to thunderbolt, please refer to this article. In case this article will not help, there is nothing to add from our side due to it's not driver issue.

Bernardbaurin commented 3 years ago

Hi, Here is my configuration:

ESXI version:

[root@esx1:~] vmware -v
VMware ESXi 7.0.1 build-17325551

Components installed:

OWC Thunderbolt 3 adapter is well listed in lspci with '0000:0c:00.0 Ethernet controller: Aquantia Corp. AQC107'

[root@esx1:~] lspci
0000:00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v6/7th Gen Core Processor Host Bridge/DRAM Registers
0000:00:01.0 PCI bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor PCIe Controller (x16) [PCIe RP[0000:00:01.0]]
0000:00:01.1 PCI bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor PCIe Controller (x8) [PCIe RP[0000:00:01.1]]
0000:00:01.2 PCI bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor PCIe Controller (x4) [PCIe RP[0000:00:01.2]]
0000:00:02.0 Display controller: Intel Corporation HD Graphics 630
0000:00:08.0 System peripheral: Intel Corporation Xeon E3-1200 v5/v6 / E3-1500 v5 / 6th/7th/8th Gen Core Processor Gaussian Mixture Model
0000:00:14.0 USB controller: Intel Corporation 100 Series/C230 Series Chipset Family USB 3.0 xHCI Controller
0000:00:14.2 Signal processing controller: Intel Corporation 100 Series/C230 Series Chipset Family Thermal Subsystem
0000:00:15.0 Signal processing controller: Intel Corporation 100 Series/C230 Series Chipset Family Serial IO I2C Controller #0
0000:00:15.1 Signal processing controller: Intel Corporation 100 Series/C230 Series Chipset Family Serial IO I2C Controller #1
0000:00:15.2 Signal processing controller: Intel Corporation 100 Series/C230 Series Chipset Family Serial IO I2C Controller #2
0000:00:16.0 Communication controller: Intel Corporation 100 Series/C230 Series Chipset Family MEI Controller #1
0000:00:1c.0 PCI bridge: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #1 [PCIe RP[0000:00:1c.0]]
0000:00:1c.1 PCI bridge: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #2 [PCIe RP[0000:00:1c.1]]
0000:00:1c.2 PCI bridge: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #3 [PCIe RP[0000:00:1c.2]]
0000:00:1c.4 PCI bridge: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #5 [PCIe RP[0000:00:1c.4]]
0000:00:1d.0 PCI bridge: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #9 [PCIe RP[0000:00:1d.0]]
0000:00:1d.4 PCI bridge: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #13 [PCIe RP[0000:00:1d.4]]
0000:00:1e.0 Signal processing controller: Intel Corporation 100 Series/C230 Series Chipset Family Serial IO UART #0
0000:00:1f.0 ISA bridge: Intel Corporation HM175 Chipset LPC/eSPI Controller
0000:00:1f.2 Memory controller: Intel Corporation 100 Series/C230 Series Chipset Family Power Management Controller
0000:00:1f.3 Audio device: Intel Corporation CM238 HD Audio Controller
0000:00:1f.4 SMBus: Intel Corporation 100 Series/C230 Series Chipset Family SMBus
0000:00:1f.6 Ethernet controller: Intel Corporation Ethernet Connection (2) I219-LM [vmnic0]
0000:01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Polaris 22 XL [Radeon RX Vega M GL]
0000:01:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Polaris 22 HDMI Audio
0000:02:00.0 USB controller: ASMedia Technology Inc. ASM2142 USB 3.1 Host Controller
0000:03:00.0 SD Host controller: O2 Micro, Inc. SD/MMC Card Reader Controller
0000:05:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection [vmnic1]
0000:06:00.0 Network controller: Intel Corporation Dual Band Wireless-AC 8265
0000:07:00.0 PCI bridge: Intel Corporation JHL6540 Thunderbolt 3 Bridge (C step) [Alpine Ridge 4C 2016]
0000:08:00.0 PCI bridge: Intel Corporation JHL6540 Thunderbolt 3 Bridge (C step) [Alpine Ridge 4C 2016]
0000:08:01.0 PCI bridge: Intel Corporation JHL6540 Thunderbolt 3 Bridge (C step) [Alpine Ridge 4C 2016]
0000:08:02.0 PCI bridge: Intel Corporation JHL6540 Thunderbolt 3 Bridge (C step) [Alpine Ridge 4C 2016]
0000:08:04.0 PCI bridge: Intel Corporation JHL6540 Thunderbolt 3 Bridge (C step) [Alpine Ridge 4C 2016]
0000:09:00.0 System peripheral: Intel Corporation JHL6540 Thunderbolt 3 NHI (C step) [Alpine Ridge 4C 2016]
0000:0a:00.0 PCI bridge: Intel Corporation JHL6340 Thunderbolt 3 Bridge (C step) [Alpine Ridge 2C 2016]
0000:0b:01.0 PCI bridge: Intel Corporation JHL6340 Thunderbolt 3 Bridge (C step) [Alpine Ridge 2C 2016]
0000:0c:00.0 Ethernet controller: Aquantia Corp. AQC107 NBase-T/IEEE 802.3bz Ethernet Controller [AQtion]
0000:72:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981/PM983 [vmhba0]
0000:73:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981/PM983 [vmhba1]

But the OWC adapter does not appear

[root@esx1:~] esxcli network nic list
Name    PCI Device    Driver  Admin Status  Link Status  Speed  Duplex  MAC Address         MTU  Description
------  ------------  ------  ------------  -----------  -----  ------  -----------------  ----  -----------
vmnic0  0000:00:1f.6  ne1000  Up            Up            1000  Full    54:b2:03:89:6c:46  1500  Intel Corporation Ethernet Connection (2) I219-LM
vmnic1  0000:05:00.0  igbn    Up            Up            1000  Full    54:b2:03:89:6c:47  1500  Intel Corporation I210 Gigabit Network Connection

I suspect a driver issue : what's your advice ?

Regards

jonesxcli commented 3 years ago

Hi, Here is my configuration:

  • IntelNuc NUC8i7HNK
  • OWC Thunderbolt 3 to 10G Ethernet Adapter

ESXI version:

[root@esx1:~] vmware -v
VMware ESXi 7.0.1 build-17325551

Components installed:

  • ESXi701-VMKUSB-NIC-FLING-40599856-component-17078334.zip
  • MRVL-Atlantic-Driver-Bundle_1.0.2.0-1OEM.670.0.0.8169922-16081713.zip

OWC Thunderbolt 3 adapter is well listed in lspci with '0000:0c:00.0 Ethernet controller: Aquantia Corp. AQC107'

[root@esx1:~] lspci
0000:00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v6/7th Gen Core Processor Host Bridge/DRAM Registers
0000:00:01.0 PCI bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor PCIe Controller (x16) [PCIe RP[0000:00:01.0]]
0000:00:01.1 PCI bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor PCIe Controller (x8) [PCIe RP[0000:00:01.1]]
0000:00:01.2 PCI bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor PCIe Controller (x4) [PCIe RP[0000:00:01.2]]
0000:00:02.0 Display controller: Intel Corporation HD Graphics 630
0000:00:08.0 System peripheral: Intel Corporation Xeon E3-1200 v5/v6 / E3-1500 v5 / 6th/7th/8th Gen Core Processor Gaussian Mixture Model
0000:00:14.0 USB controller: Intel Corporation 100 Series/C230 Series Chipset Family USB 3.0 xHCI Controller
0000:00:14.2 Signal processing controller: Intel Corporation 100 Series/C230 Series Chipset Family Thermal Subsystem
0000:00:15.0 Signal processing controller: Intel Corporation 100 Series/C230 Series Chipset Family Serial IO I2C Controller #0
0000:00:15.1 Signal processing controller: Intel Corporation 100 Series/C230 Series Chipset Family Serial IO I2C Controller #1
0000:00:15.2 Signal processing controller: Intel Corporation 100 Series/C230 Series Chipset Family Serial IO I2C Controller #2
0000:00:16.0 Communication controller: Intel Corporation 100 Series/C230 Series Chipset Family MEI Controller #1
0000:00:1c.0 PCI bridge: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #1 [PCIe RP[0000:00:1c.0]]
0000:00:1c.1 PCI bridge: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #2 [PCIe RP[0000:00:1c.1]]
0000:00:1c.2 PCI bridge: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #3 [PCIe RP[0000:00:1c.2]]
0000:00:1c.4 PCI bridge: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #5 [PCIe RP[0000:00:1c.4]]
0000:00:1d.0 PCI bridge: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #9 [PCIe RP[0000:00:1d.0]]
0000:00:1d.4 PCI bridge: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #13 [PCIe RP[0000:00:1d.4]]
0000:00:1e.0 Signal processing controller: Intel Corporation 100 Series/C230 Series Chipset Family Serial IO UART #0
0000:00:1f.0 ISA bridge: Intel Corporation HM175 Chipset LPC/eSPI Controller
0000:00:1f.2 Memory controller: Intel Corporation 100 Series/C230 Series Chipset Family Power Management Controller
0000:00:1f.3 Audio device: Intel Corporation CM238 HD Audio Controller
0000:00:1f.4 SMBus: Intel Corporation 100 Series/C230 Series Chipset Family SMBus
0000:00:1f.6 Ethernet controller: Intel Corporation Ethernet Connection (2) I219-LM [vmnic0]
0000:01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Polaris 22 XL [Radeon RX Vega M GL]
0000:01:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Polaris 22 HDMI Audio
0000:02:00.0 USB controller: ASMedia Technology Inc. ASM2142 USB 3.1 Host Controller
0000:03:00.0 SD Host controller: O2 Micro, Inc. SD/MMC Card Reader Controller
0000:05:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection [vmnic1]
0000:06:00.0 Network controller: Intel Corporation Dual Band Wireless-AC 8265
0000:07:00.0 PCI bridge: Intel Corporation JHL6540 Thunderbolt 3 Bridge (C step) [Alpine Ridge 4C 2016]
0000:08:00.0 PCI bridge: Intel Corporation JHL6540 Thunderbolt 3 Bridge (C step) [Alpine Ridge 4C 2016]
0000:08:01.0 PCI bridge: Intel Corporation JHL6540 Thunderbolt 3 Bridge (C step) [Alpine Ridge 4C 2016]
0000:08:02.0 PCI bridge: Intel Corporation JHL6540 Thunderbolt 3 Bridge (C step) [Alpine Ridge 4C 2016]
0000:08:04.0 PCI bridge: Intel Corporation JHL6540 Thunderbolt 3 Bridge (C step) [Alpine Ridge 4C 2016]
0000:09:00.0 System peripheral: Intel Corporation JHL6540 Thunderbolt 3 NHI (C step) [Alpine Ridge 4C 2016]
0000:0a:00.0 PCI bridge: Intel Corporation JHL6340 Thunderbolt 3 Bridge (C step) [Alpine Ridge 2C 2016]
0000:0b:01.0 PCI bridge: Intel Corporation JHL6340 Thunderbolt 3 Bridge (C step) [Alpine Ridge 2C 2016]
0000:0c:00.0 Ethernet controller: Aquantia Corp. AQC107 NBase-T/IEEE 802.3bz Ethernet Controller [AQtion]
0000:72:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981/PM983 [vmhba0]
0000:73:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981/PM983 [vmhba1]

But the OWC adapter does not appear

[root@esx1:~] esxcli network nic list
Name    PCI Device    Driver  Admin Status  Link Status  Speed  Duplex  MAC Address         MTU  Description
------  ------------  ------  ------------  -----------  -----  ------  -----------------  ----  -----------
vmnic0  0000:00:1f.6  ne1000  Up            Up            1000  Full    54:b2:03:89:6c:46  1500  Intel Corporation Ethernet Connection (2) I219-LM
vmnic1  0000:05:00.0  igbn    Up            Up            1000  Full    54:b2:03:89:6c:47  1500  Intel Corporation I210 Gigabit Network Connection

I suspect a driver issue : what's your advice ?

Regards

Currently running ESXi 7.0U1c on NUC8i7HVK with OWC TB3 10Gbe adapter with no issues.

esxcli hardware platform get

Platform Information UUID: 0x9 0x84 0x49 0x68 0x9e 0x93 0x4d 0xa6 0x8e 0xad 0x54 0xb2 0x3 0x18 0xae 0x43 Product Name: NUC8i7HVK Vendor Name: Intel(R) Client Systems Enclosure Serial Number: BIOS Asset Tag: IPMI Supported: false

vmware-v

VMware ESXi 7.0.1 build-17325551

esxcli network nic list

Name PCI Device Driver Admin Status Link Status Speed Duplex MAC Address MTU Description

vmnic0 0000:00:1f.6 ne1000 Up Up 1000 Full 54:b2:03:18:ae:43 9000 Intel Corporation Ethernet Connection (2) I219-LM vmnic1 0000:05:00.0 igbn Up Up 1000 Full 54:b2:03:18:ae:44 9000 Intel Corporation I210 Gigabit Network Connection vmnic2 0000:0b:00.0 atlantic Up Up 10000 Full 00:30:93:17:0a:1a 9000 Marvell AQtion 10Gbit Network Adapter vusb0 Pseudo uether Up Down 0 Half 24:5e:be:4f:89:44 9000 QNAP QNAP QNA-UC5G1T USB to 5GbE Adapter

esxcli software vib list | more

Name Version Vendor Acceptance Level Install Date

atlantic 1.0.2.0-1OEM.670.0.0.8169922 MRVL VMwareCertified 2020-11-22 bnxtnet 216.0.50.0-16vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 bnxtroce 216.0.58.0-7vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 brcmfcoe 12.0.1500.0-1vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 brcmnvmefc 12.6.278.10-3vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 elxiscsi 12.0.1200.0-2vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 elxnet 12.0.1250.0-5vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 i40en 1.8.1.123-1vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 i40iwn 1.1.2.6-1vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 iavmd 2.0.0.1055-5vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 icen 1.0.0.9-1vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 igbn 0.1.1.0-7vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 iser 1.1.0.1-1vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 ixgben 1.7.1.28-1vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 lpfc 12.6.278.10-8vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 lpnic 11.4.62.0-1vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 lsi-mr3 7.712.51.00-1vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 lsi-msgpt2 20.00.06.00-3vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 lsi-msgpt35 13.00.13.00-2vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 lsi-msgpt3 17.00.10.00-2vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 mtip32xx-native 3.9.8-1vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 ne1000 0.8.4-11vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 nenic 1.0.29.0-2vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 nfnic 4.0.0.44-2vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 nhpsa 70.0051.0.100-2vmw.701.0.25.17325551 VMW VMwareCertified 2021-01-03 nmlx4-core 3.19.16.8-2vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 nmlx4-en 3.19.16.8-2vmw.701.0.0.16850804 VMW VMwareCertified 2020-11-22 --More--

lspci

0000:00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v6/7th Gen Core Processor Host Bridge/DRAM Registers 0000:00:01.0 PCI bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor PCIe Controller (x16) [PCIe RP[0000:00:01.0]] 0000:00:01.1 PCI bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor PCIe Controller (x8) [PCIe RP[0000:00:01.1]] 0000:00:01.2 PCI bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor PCIe Controller (x4) [PCIe RP[0000:00:01.2]] 0000:00:02.0 Display controller: Intel Corporation HD Graphics 630 0000:00:08.0 System peripheral: Intel Corporation Xeon E3-1200 v5/v6 / E3-1500 v5 / 6th/7th/8th Gen Core Processor Gaussian Mixture Model 0000:00:14.0 USB controller: Intel Corporation 100 Series/C230 Series Chipset Family USB 3.0 xHCI Controller 0000:00:14.2 Signal processing controller: Intel Corporation 100 Series/C230 Series Chipset Family Thermal Subsystem 0000:00:15.0 Signal processing controller: Intel Corporation 100 Series/C230 Series Chipset Family Serial IO I2C Controller #0 0000:00:15.1 Signal processing controller: Intel Corporation 100 Series/C230 Series Chipset Family Serial IO I2C Controller #1 0000:00:15.2 Signal processing controller: Intel Corporation 100 Series/C230 Series Chipset Family Serial IO I2C Controller #2 0000:00:16.0 Communication controller: Intel Corporation 100 Series/C230 Series Chipset Family MEI Controller #1 0000:00:17.0 SATA controller: Intel Corporation Sunrise Point-H AHCI Controller [vmhba0] 0000:00:1c.0 PCI bridge: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #1 [PCIe RP[0000:00:1c.0]] 0000:00:1c.1 PCI bridge: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #2 [PCIe RP[0000:00:1c.1]] 0000:00:1c.4 PCI bridge: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #5 [PCIe RP[0000:00:1c.4]] 0000:00:1d.0 PCI bridge: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #9 [PCIe RP[0000:00:1d.0]] 0000:00:1d.4 PCI bridge: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #13 [PCIe RP[0000:00:1d.4]] 0000:00:1e.0 Signal processing controller: Intel Corporation 100 Series/C230 Series Chipset Family Serial IO UART #0 0000:00:1f.0 ISA bridge: Intel Corporation HM175 Chipset LPC/eSPI Controller 0000:00:1f.2 Memory controller: Intel Corporation 100 Series/C230 Series Chipset Family Power Management Controller 0000:00:1f.3 Audio device: Intel Corporation CM238 HD Audio Controller 0000:00:1f.4 SMBus: Intel Corporation 100 Series/C230 Series Chipset Family SMBus 0000:00:1f.6 Ethernet controller: Intel Corporation Ethernet Connection (2) I219-LM [vmnic0] 0000:01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Polaris 22 XT [Radeon RX Vega M GH] 0000:01:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Polaris 22 HDMI Audio 0000:02:00.0 USB controller: ASMedia Technology Inc. ASM2142 USB 3.1 Host Controller 0000:03:00.0 SD Host controller: O2 Micro, Inc. SD/MMC Card Reader Controller 0000:05:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection [vmnic1] 0000:06:00.0 PCI bridge: Intel Corporation JHL6540 Thunderbolt 3 Bridge (C step) [Alpine Ridge 4C 2016] 0000:07:00.0 PCI bridge: Intel Corporation JHL6540 Thunderbolt 3 Bridge (C step) [Alpine Ridge 4C 2016] 0000:07:01.0 PCI bridge: Intel Corporation JHL6540 Thunderbolt 3 Bridge (C step) [Alpine Ridge 4C 2016] 0000:07:02.0 PCI bridge: Intel Corporation JHL6540 Thunderbolt 3 Bridge (C step) [Alpine Ridge 4C 2016] 0000:07:04.0 PCI bridge: Intel Corporation JHL6540 Thunderbolt 3 Bridge (C step) [Alpine Ridge 4C 2016] 0000:08:00.0 System peripheral: Intel Corporation JHL6540 Thunderbolt 3 NHI (C step) [Alpine Ridge 4C 2016] 0000:09:00.0 PCI bridge: Intel Corporation JHL6340 Thunderbolt 3 Bridge (C step) [Alpine Ridge 2C 2016] 0000:0a:01.0 PCI bridge: Intel Corporation JHL6340 Thunderbolt 3 Bridge (C step) [Alpine Ridge 2C 2016] 0000:0b:00.0 Ethernet controller: Marvell AQtion 10Gbit Network Adapter [vmnic2] 0000:72:00.0 Non-Volatile memory controller: Phison Electronics Corporation E7 NVMe Controller [vmhba1] 0000:72:08.0 Non-Volatile memory controller: Phison Electronics Corporation E7 NVMe Controller 0000:72:10.0 Non-Volatile memory controller: Phison Electronics Corporation E7 NVMe Controller [vmhba2] 0000:72:18.0 Non-Volatile memory controller: Phison Electronics Corporation E7 NVMe Controller

Bernardbaurin commented 3 years ago

Hi Jonesxcli,

Thank you very much for the time passed in analyzing my issue and your help ! Here are the answers to your questions.

boot

secure boot is enabled

esxcli software vib list

Name                           Version                               Vendor  Acceptance Level  Install Date
-----------------------------  ------------------------------------  ------  ----------------  ------------
bnxtnet                        216.0.50.0-16vmw.701.0.0.16850804     VMW     VMwareCertified   2021-01-03
bnxtroce                       216.0.58.0-7vmw.701.0.0.16850804      VMW     VMwareCertified   2021-01-03
brcmfcoe                       12.0.1500.0-1vmw.701.0.0.16850804     VMW     VMwareCertified   2021-01-03
brcmnvmefc                     12.6.278.10-3vmw.701.0.0.16850804     VMW     VMwareCertified   2021-01-03
elxiscsi                       12.0.1200.0-2vmw.701.0.0.16850804     VMW     VMwareCertified   2021-01-03
elxnet                         12.0.1250.0-5vmw.701.0.0.16850804     VMW     VMwareCertified   2021-01-03
i40en                          1.8.1.123-1vmw.701.0.0.16850804       VMW     VMwareCertified   2021-01-03
i40iwn                         1.1.2.6-1vmw.701.0.0.16850804         VMW     VMwareCertified   2021-01-03
iavmd                          2.0.0.1055-5vmw.701.0.0.16850804      VMW     VMwareCertified   2021-01-03
icen                           1.0.0.9-1vmw.701.0.0.16850804         VMW     VMwareCertified   2021-01-03
igbn                           0.1.1.0-7vmw.701.0.0.16850804         VMW     VMwareCertified   2021-01-03
iser                           1.1.0.1-1vmw.701.0.0.16850804         VMW     VMwareCertified   2021-01-03
ixgben                         1.7.1.28-1vmw.701.0.0.16850804        VMW     VMwareCertified   2021-01-03
lpfc                           12.6.278.10-8vmw.701.0.0.16850804     VMW     VMwareCertified   2021-01-03
lpnic                          11.4.62.0-1vmw.701.0.0.16850804       VMW     VMwareCertified   2021-01-03
lsi-mr3                        7.712.51.00-1vmw.701.0.0.16850804     VMW     VMwareCertified   2021-01-03
lsi-msgpt2                     20.00.06.00-3vmw.701.0.0.16850804     VMW     VMwareCertified   2021-01-03
lsi-msgpt35                    13.00.13.00-2vmw.701.0.0.16850804     VMW     VMwareCertified   2021-01-03
lsi-msgpt3                     17.00.10.00-2vmw.701.0.0.16850804     VMW     VMwareCertified   2021-01-03
mtip32xx-native                3.9.8-1vmw.701.0.0.16850804           VMW     VMwareCertified   2021-01-03
ne1000                         0.8.4-11vmw.701.0.0.16850804          VMW     VMwareCertified   2021-01-03
nenic                          1.0.29.0-2vmw.701.0.0.16850804        VMW     VMwareCertified   2021-01-03
nfnic                          4.0.0.44-2vmw.701.0.0.16850804        VMW     VMwareCertified   2021-01-03
nhpsa                          70.0051.0.100-2vmw.701.0.25.17325551  VMW     VMwareCertified   2021-01-03
nmlx4-core                     3.19.16.8-2vmw.701.0.0.16850804       VMW     VMwareCertified   2021-01-03
nmlx4-en                       3.19.16.8-2vmw.701.0.0.16850804       VMW     VMwareCertified   2021-01-03
nmlx4-rdma                     3.19.16.8-2vmw.701.0.0.16850804       VMW     VMwareCertified   2021-01-03
nmlx5-core                     4.19.16.8-2vmw.701.0.0.16850804       VMW     VMwareCertified   2021-01-03
nmlx5-rdma                     4.19.16.8-2vmw.701.0.0.16850804       VMW     VMwareCertified   2021-01-03
ntg3                           4.1.5.0-0vmw.701.0.0.16850804         VMW     VMwareCertified   2021-01-03
nvme-pcie                      1.2.3.9-2vmw.701.0.0.16850804         VMW     VMwareCertified   2021-01-03
nvmerdma                       1.0.1.2-1vmw.701.0.20.17325020        VMW     VMwareCertified   2021-01-03
nvmxnet3-ens                   2.0.0.22-1vmw.701.0.0.16850804        VMW     VMwareCertified   2021-01-03
nvmxnet3                       2.0.0.30-1vmw.701.0.0.16850804        VMW     VMwareCertified   2021-01-03
pvscsi                         0.1-2vmw.701.0.0.16850804             VMW     VMwareCertified   2021-01-03
qcnic                          1.0.15.0-10vmw.701.0.0.16850804       VMW     VMwareCertified   2021-01-03
qedentv                        3.40.3.0-12vmw.701.0.0.16850804       VMW     VMwareCertified   2021-01-03
qedrntv                        3.40.4.0-12vmw.701.0.0.16850804       VMW     VMwareCertified   2021-01-03
qfle3                          1.0.67.0-9vmw.701.0.0.16850804        VMW     VMwareCertified   2021-01-03
qfle3f                         1.0.51.0-14vmw.701.0.0.16850804       VMW     VMwareCertified   2021-01-03
qfle3i                         1.0.15.0-9vmw.701.0.0.16850804        VMW     VMwareCertified   2021-01-03
qflge                          1.1.0.11-1vmw.701.0.0.16850804        VMW     VMwareCertified   2021-01-03
rste                           2.0.2.0088-7vmw.701.0.0.16850804      VMW     VMwareCertified   2021-01-03
sfvmk                          2.4.0.0010-15vmw.701.0.0.16850804     VMW     VMwareCertified   2021-01-03
smartpqi                       70.4000.0.100-4vmw.701.0.25.17325551  VMW     VMwareCertified   2021-01-03
vmkata                         0.1-1vmw.701.0.25.17325551            VMW     VMwareCertified   2021-01-03
vmkfcoe                        1.0.0.2-1vmw.701.0.20.17325020        VMW     VMwareCertified   2021-01-03
vmkusb-nic-fling               2.1-6vmw.701.0.0.40599856             VMW     VMwareCertified   2021-01-03
vmkusb                         0.1-1vmw.701.0.25.17325551            VMW     VMwareCertified   2021-01-03
vmw-ahci                       2.0.5-2vmw.701.0.0.16850804           VMW     VMwareCertified   2021-01-03
cpu-microcode                  7.0.1-0.25.17325551                   VMware  VMwareCertified   2021-01-03
crx                            7.0.1-0.25.17325551                   VMware  VMwareCertified   2021-01-03
elx-esx-libelxima.so           12.0.1200.0-3vmw.701.0.0.16850804     VMware  VMwareCertified   2021-01-03
esx-base                       7.0.1-0.25.17325551                   VMware  VMwareCertified   2021-01-03
esx-dvfilter-generic-fastpath  7.0.1-0.25.17325551                   VMware  VMwareCertified   2021-01-03
esx-ui                         1.34.4-16668064                       VMware  VMwareCertified   2021-01-03
esx-update                     7.0.1-0.25.17325551                   VMware  VMwareCertified   2021-01-03
esx-xserver                    7.0.1-0.25.17325551                   VMware  VMwareCertified   2021-01-03
gc                             7.0.1-0.25.17325551                   VMware  VMwareCertified   2021-01-03
loadesx                        7.0.1-0.25.17325551                   VMware  VMwareCertified   2021-01-03
lsuv2-hpv2-hpsa-plugin         1.0.0-3vmw.701.0.0.16850804           VMware  VMwareCertified   2021-01-03
lsuv2-intelv2-nvme-vmd-plugin  1.0.0-2vmw.701.0.0.16850804           VMware  VMwareCertified   2021-01-03
lsuv2-lsiv2-drivers-plugin     1.0.0-4vmw.701.0.0.16850804           VMware  VMwareCertified   2021-01-03
lsuv2-nvme-pcie-plugin         1.0.0-1vmw.701.0.0.16850804           VMware  VMwareCertified   2021-01-03
lsuv2-oem-dell-plugin          1.0.0-1vmw.701.0.0.16850804           VMware  VMwareCertified   2021-01-03
lsuv2-oem-hp-plugin            1.0.0-1vmw.701.0.0.16850804           VMware  VMwareCertified   2021-01-03
lsuv2-oem-lenovo-plugin        1.0.0-1vmw.701.0.0.16850804           VMware  VMwareCertified   2021-01-03
lsuv2-smartpqiv2-plugin        1.0.0-4vmw.701.0.0.16850804           VMware  VMwareCertified   2021-01-03
native-misc-drivers            7.0.1-0.25.17325551                   VMware  VMwareCertified   2021-01-03
qlnativefc                     4.0.3.0-17vmw.701.0.0.16850804        VMware  VMwareCertified   2021-01-03
vdfs                           7.0.1-0.25.17325551                   VMware  VMwareCertified   2021-01-03
vmware-esx-esxcli-nvme-plugin  1.2.0.38-1vmw.701.0.0.16850804        VMware  VMwareCertified   2021-01-03
vsan                           7.0.1-0.25.17325551                   VMware  VMwareCertified   2021-01-03
vsanhealth                     7.0.1-0.25.17325551                   VMware  VMwareCertified   2021-01-03
tools-light                    11.1.1.16303738-16850804              VMware  VMwareCertified   2021-01-03

extract from vmkernel.log

Lot of lines about ne1000 and igbn but no ones about Ethernet controller: Aquantia Corp. AQC107 NBase-T/IEEE 802.3bz Ethernet Controller [AQtion]

...
2021-01-04T04:53:49.412Z cpu0:1049107)vmkusb_nic_fling: xhci_parse_protocol:755: usb 3.1 bus protocol: port range 1-2, psic=0
2021-01-04T04:53:49.412Z cpu0:1049107)vmkusb_nic_fling: xhci_parse_protocol:755: usb 2.0 bus protocol: port range 3-4, psic=0
2021-01-04T04:53:49.412Z cpu0:1049107)vmkusb_nic_fling: xhci_ssp_init:862: xHCI's SBRN is not set properly: expect 0x31, actual 0x30. Ignored
2021-01-04T04:53:49.412Z cpu0:1049107)vmkusb_nic_fling: xhci_init:1027: found SuperSpeedPlus xhci host controller
...
2021-01-04T04:53:50.470Z cpu4:1048699)igbn: indrv_EventISR:925: Event ISR called on pf 0x430a5f403880
2021-01-04T04:53:50.470Z cpu4:1049134)igbn: indrv_Worker:2035: Checking async events for device 0x430a5f403880
2021-01-04T04:53:50.471Z cpu4:1049134)igbn: igbn_CheckLink:1271: Link got up for device 0x430a5f403880
2021-01-04T04:53:50.991Z cpu2:1049107)Device: 330: Found driver vmkusb_nic_fling for device 0x7a2e430555202d80
...

BIOS

Thunderbolt Controller and Thunderbolt boot are both enabled

Bernardbaurin commented 3 years ago

Maybe, an idea : I have tried again to install the Atlantic driver.

Atlantic Driver installation failed

[root@esx1:~] esxcli software component apply -d /tmp/MRVL-Atlantic-Driver-Bundle_1.0.2.0-1OEM.670.0.0.8169922-16081713.zip
 [MetadataDownloadError]
 Could not download from depot at zip:/tmp/MRVL-Atlantic-Driver-Bundle_1.0.2.0-1OEM.670.0.0.8169922-16081713.zip?index.xml, skipping (('zip:/tmp/MRVL-Atlantic-Driver-Bundle_1.0.2.0-1OEM.670.0.0.8169922-16081713.zip?index.xml', '', 'Error extracting index.xml from /tmp/MRVL-Atlantic-Driver-Bundle_1.0.2.0-1OEM.670.0.0.8169922-16081713.zip: "There is no item named \'index.xml\' in the archive"'))
        url = zip:/tmp/MRVL-Atlantic-Driver-Bundle_1.0.2.0-1OEM.670.0.0.8169922-16081713.zip?index.xml
 Please refer to the log file for more details.
dimbez commented 3 years ago

Components installed:

* ESXi701-VMKUSB-NIC-FLING-40599856-component-17078334.zip

* MRVL-Atlantic-Driver-Bundle_1.0.2.0-1OEM.670.0.0.8169922-16081713.zip

Hi @Bernardbaurin. Using of ESXi701-VMKUSB-NIC-FLING-40599856-component-17078334.zip is not required to make Thunderbolt device work.

Atlantic Driver installation failed

This is offline bundle, not a component. So please use esxcli software vib install -d <full path>

Bernardbaurin commented 3 years ago

Hi @dimbez,

Thank you for your answer : I agree with you, but the error is the same

[root@esx1:~] esxcli software vib install -d /tmp/MRVL-Atlantic-Driver-Bundle_1.0.2.0-1OEM.670.0.0.8169922-16081713.zip
 [MetadataDownloadError]
 Could not download from depot at zip:/tmp/MRVL-Atlantic-Driver-Bundle_1.0.2.0-1OEM.670.0.0.8169922-16081713.zip?index.xml, skipping (('zip:/tmp/MRVL-Atlantic-Driver-Bundle_1.0.2.0-1OEM.670.0.0.8169922-16081713.zip?index.xml', '', 'Error extracting index.xml from /tmp/MRVL-Atlantic-Driver-Bundle_1.0.2.0-1OEM.670.0.0.8169922-16081713.zip: "There is no item named \'index.xml\' in the archive"'))
        url = zip:/tmp/MRVL-Atlantic-Driver-Bundle_1.0.2.0-1OEM.670.0.0.8169922-16081713.zip?index.xml
 Please refer to the log file for more details.
dimbez commented 3 years ago

Hi, it seems you did not unpacked original .zip. It contains offline bundle (MRVL-Atlantic-Driver-Bundle_1.0.2.0-1OEM.670.0.0.8169922-offline-bundle-16081713.zip) and docs folder with readme and release notes.

Bernardbaurin commented 3 years ago

Hi, Well viewed ! After unpack the initial zip, I found another one inside and the setup succeeded !

Setup of Atlantic-Driver with success

[root@esx1:~] esxcli software vib install -d /tmp/MRVL-Atlantic-Driver-Bundle_1.0.2.0-1OEM.670.0.0.8169922-offline-bundle-16081713.zip
Installation Result
   Message: The update completed successfully, but the system needs to be rebooted for the changes to be effective.
   Reboot Required: true
   VIBs Installed: MRVL_bootbank_atlantic_1.0.2.0-1OEM.670.0.0.8169922
   VIBs Removed:
   VIBs Skipped:

esxcli network nic list

By default, the Link is Up and the Speed 1000

Name    PCI Device    Driver    Admin Status  Link Status  Speed  Duplex  MAC Address         MTU  Description
------  ------------  --------  ------------  -----------  -----  ------  -----------------  ----  -----------
vmnic0  0000:00:1f.6  ne1000    Up            Up            1000  Full    54:b2:03:89:6c:46  1500  Intel Corporation Ethernet Connection (2) I219-LM
vmnic1  0000:05:00.0  igbn      Up            Up            1000  Full    54:b2:03:89:6c:47  1500  Intel Corporation I210 Gigabit Network Connection
vmnic2  0000:0c:00.0  atlantic  Up            Up            1000  Full    00:23:a4:02:01:bf  1500  Marvell AQtion 10Gbit Network Adapter

My switch is a 1 Gbe switch : I will change it very soon with a 10 Gbe one !

Thank you very much for your help !!!

dimbez commented 3 years ago

Nice to hear it helped!

mpsec4170 commented 2 years ago

I've just set up the ESXi 7.0.U3c and facing the issue where my Marvell AQtion 10 Gb (AQC107) Ethernet Controller is not reflecting on the NIC. Need some help on how to troubleshoot this! Image only reflects my Intel Ethernet Controller. PIC 1 !

dimbez commented 2 years ago

@mpsec4170 Hi, please provide an output of devices list: esxcli hardware pci list

mpsec4170 commented 2 years ago

Is this what you're looking for?

image

dimbez commented 2 years ago

@mpsec4170, right, this is exactly I'd like to see. Unfortunately it's next generation of AQC hardware, it's not supported by native driver. There is no information if it's planned to include support of these devices.

mpsec4170 commented 2 years ago

I see. I'm sorry as this is still quite new to me and the question may sound stupid. But how do you tell which generation it is? Or what should I look out for if I want to know this will be supported in the next ESXi update?

dimbez commented 2 years ago

Field device ID: 0x94C0. It means it's AQC113 based devices. Here is example of device IDs: https://elixir.bootlin.com/linux/latest/source/drivers/net/ethernet/aquantia/atlantic/aq_common.h#L41 All, which contains AQC113/4/5/6 - is AQC113 based.

mpsec4170 commented 2 years ago

Thanks @dimbez for fast response, advice and helpful tip! Really appreciate it man!