search

kohler / click

The Click modular router: fast modular packet processing and analysis
Other
740 stars 321 forks source link

Multiple independent DPDK enabled click applications #365

Open antonis-m opened 7 years ago

antonis-m commented 7 years ago

Hello,

As the title says, I would like to run multiple independent dpdk enabled click processes. I have enough DPDK ports ( I do not want to go through a virtual switch) and my processes are supposed to process different streams of traffic. I use the --file-prefix option as a parameter in my configuration in order not to run in to sharing issues of the hugepages but still, when I spawn a second click application, the first one hangs and stops making any progress. Any help or pointer as to why this happens would be greatly appreciated.

Thank you !

tbarbette commented 7 years ago

So you use different NICs and different cores in each applications, right? If not can you try that? Also, is a DPDK sample application working in the same configuration? That would assert if it is a Click+DPDK problem or just your configuration missing some parameters. You must also pass the memory limit parameter (to check) to prevent one of the application from taking all huge pages. Tom

antonis-m commented 7 years ago

Hi again, thanks for the reply.

So I spent sometime running sample DPDK applications to verify the behavior. Apparently, even with simple DPDK applications (simple l2fw from the dpdk examples folder) the problem persists. As far as the other parameters are concerned, I 've made sure that I limit the memory each process has, each process has its own file prefix and so on.

I noticed in the limitations section of multi-process support of DPDK it says that the delivery of interrupts, such as Ethernet* device link status interrupts, do not work in secondary processes. But that should not be a problem in my case ...

tbarbette commented 7 years ago

What you are trying to do is, as you said, not a secondary process scheme. I suggest you try on the DPDK user mailing list as this problem does not seem Click-related.

antonis-m commented 7 years ago

Thank you, I am trying to find a workaround to this problem. One last question, Is the latest version of click compatible with DPDK 17.05. ?

Thank you

tbarbette commented 7 years ago

No it's not. I think it's compiling but failing. I must change a few things. I do a compatibility pass from time to time ;) Don't hesitate to come back here if you find a solution.