search

amzn / amzn-drivers

Official AWS drivers repository for Elastic Network Adapter (ENA) and Elastic Fabric Adapter (EFA)
455 stars 175 forks source link

DPDK binding unbinding ENA to igb_uio #99

Closed NAYANSEN90 closed 5 years ago

NAYANSEN90 commented 5 years ago

Hi, So I am testing DPDK in AWS "m5.large" instance. The instance has 2 interfaces, both with ena drivers. I am currently using dpdk 18.05 version.
Steps of the issue:

  1. ifconfig down.
  2. Bind the pci_device to igb_uio.
  3. Bind the pci_device back to ena.
  4. ifconfig up.

At the 4th stage the connection to the instance is lost. I am binding and unbinding the device that doesn't contain the ssh connection. I need to reboot the system to get everything back.

Can you help me? Thanks, Nayan

NAYANSEN90 commented 5 years ago

Additional info: The AWS instance is running OS: Centos7.4 , kernel = 3.10.0-693.21.1.el7.x86_64 I am using the "dpdk-devbind.py" script to bind the drivers. Modinfo ena output: filename: /lib/modules/3.10.0-693.21.1.el7.x86_64/kernel/drivers/net/ethernet/amazon/ena/ena.ko.xz version: 1.0.2 license: GPL description: Elastic Network Adapter (ENA) author: Amazon.com, Inc. or its affiliates retpoline: Y rhelversion: 7.4 srcversion: 3A6B9F1766C9A0B5CBC7D01 alias: pci:v00001D0Fd0000EC21svsdbcsci alias: pci:v00001D0Fd0000EC20svsdbcsci alias: pci:v00001D0Fd00001EC2svsdbcsci alias: pci:v00001D0Fd00000EC2svsdbcsci depends: intree: Y vermagic: 3.10.0-693.21.1.el7.x86_64 SMP mod_unload modversions signer: CentOS Linux kernel signing key sig_key: 03:DA:60:92:F6:71:13:21:B5:AC:E1:2E:84:5D:A9:73:36:F7:67:4D sig_hashalgo: sha256 parm: debug:Debug level (0=none,...,16=all) (int)

AWSNB commented 5 years ago

Thanks Nayan, just acknowledging receiving the issue, and folks looking at it

gtzalik commented 5 years ago

Hi @NAYANSEN90 We suspect the issue is related to network initialization scripts which is depended on your image. We will need access to your AMI for further investigation. Please contact me directly at gtzalik@amazon.com and provide the AMI or the source AMI you are using.

NAYANSEN90 commented 5 years ago

Hi @gtzalik , Thanks for the info. I have found that the problem is solved by downloading the 2.0.2g version of the driver, compiling and updating the initramfs to load the updated driver in boot time. The above issue doesn't occur and I have been able to run dpdk after that. Would you say that the driver version could be the problem?

I have sent you an email with the AMI details. Hope to hear from you soon. Thanks, Nayan

gtzalik commented 5 years ago

Hi @NAYANSEN90 It sounds like you used old driver version and you might hit old issue. I'm closing this issue for now as it resolved with the latest driver. please reopen if you need anything else. Guy