[Support]: DPDK 21.11 onwards strange issues seen in AWS 'c5a' instance family

ganesh-patwardhan commented 5 months ago

Preliminary Actions

[X] I have searched the existing issues and didn't find a duplicate.
[X] I have followed the AWS official troubleshoot documentation.
[X] I have followed the driver readme and best practices.

Driver Type

DPDK PMD for Elastic Network Adapter (ENA)

Driver Tag/Commit

ena_linux_2.0.2

Custom Code

No

OS Platform and Distribution

Custom linux

Support request

Hi With DPDK 21.11 onward (tried only DPDK 21.11 and 22.11) in AWS c5a instance family below issues are seen

DHCP ip assigned to the interface is getting lost after 4-5 hours
Instance keeps sending DHCP request but not getting any response, same time rx_missed_errors are getting incremented for each DHCP packet
This issue happens only in 'c5a' family (ex: c5a.4xlarge)
When from external VM tcp/udp packets are sent to DPDK interface those are getting in to userspace when above mentioned issue is still present.
When lot of TCP packets are sent to dpdk interface from outside suddenly things star to work (i.e interface gets DHCP IP)

Note: Its difficult to test with latest DPDK version in our product. please let me know if this is some known issue / fixed in latest version etc

Contact Details

gpatward@cisco.com

shaibran commented 5 months ago

I am not aware of such issue, but we will try to reproduce in-house. can you please share instance id and the time frame when this occurred? I will try looking in our ec2 logs

ganesh-patwardhan commented 5 months ago

Thanks Shai

Instance id : i-0540d729ec7585563 Currently instance is in same state (instance has 4 interfaces and last 2 interfaces are using DPDK which are in problematic state currently)

Regards Ganesh Patwardhan

From: shaibran @.> Date: Wednesday, 8 May 2024 at 7:26 PM To: amzn/amzn-drivers @.> Cc: Ganesh Patwardhan (gpatward) @.>, Manual @.> Subject: Re: [amzn/amzn-drivers] [Support]: DPDK 21.11 onwards strange issues seen in AWS 'c5a' instance family (Issue #300)

I am not aware of such issue, but we will try to reproduce in-house. can you please share instance id and the time frame when this occurred? I will try looking in our ec2 logs

— Reply to this email directly, view it on GitHubhttps://github.com/amzn/amzn-drivers/issues/300#issuecomment-2100638498, or unsubscribehttps://github.com/notifications/unsubscribe-auth/APFE6TDUXJ5ZVDQGKCWJAVLZBIVI7AVCNFSM6AAAAABHKXNDPCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBQGYZTQNBZHA. You are receiving this because you are subscribed to this thread.Message ID: @.***>

shaibran commented 4 months ago

Same issue is already tracked through internal ticket, resolving here.

amzn / amzn-drivers