Question: In README you mentioned "eRPC not perform well in VM by design", why?

yongming commented 4 years ago

Can you please explain why eRPC not perform well in a KVM VM like AWS EC2? Any special features only support by Mellanox NIC that eRPC depends on? or any capability is missing in vNic of VM?

Is it possibe to enhance eRPC to performance well in VM with a VIRT-IO ENI or a VF Pass-through vNic?

Thanks.

yongming commented 4 years ago

I just notice that Mellanox's driver code was modified to support erpc, is it possible do the same on virtio driver?

anujkaliaiitd commented 4 years ago

This is based on my experience from around 1.5 years ago. The situation might have improved since then:

Network performance on public clouds seems to have a lot of quirks. I've seen reports of very low packet rates with DPDK.
eRPC requires the NIC to steer flows to particular cores (e.g. Flow Director on Intel NICs, ibv_exp_create_flow on Mellanox NICs). This feature isn't always exposed to cloud guests.

I haven't tried to use eRPC on non-cloud VMs. Please let me know what happens if you try it out. Another thing to note is that if the VM has InfiniBand or RoCE working, eRPC should just work.

The modified Mellanox driver included in eRPC is for some small optimizations. eRPC works with stock Mellanox drivers that ship with Mellanox OFED.

yongming commented 4 years ago

Thanks for your comments, we will try and feedback to you.

erpc-io / eRPC

Question: In README you mentioned "eRPC not perform well in VM by design", why? #44