search

openvswitch / ovs-issues

Issue tracker repo for Open vSwitch
10 stars 3 forks source link

ovs blocked issue #261

Closed jinyan-0805 closed 1 year ago

jinyan-0805 commented 2 years ago

In our system, ovs-vswitchd blocked due to waiting for pmd73 to quiesce. the ovs-vswitchd.log print the log as fllowing all the time.

2022-08-24T07:12:42.643Z|00433|ovs_rcu(urcu2)|WARN|blocked 1000 ms waiting for pmd73 to quiesce 2022-08-24T07:12:42.647Z|07423|ovs_rcu(ovs-vswitchd)|WARN|blocked 1000 ms waiting for pmd73 to quiesce 2022-08-24T07:12:44.301Z|00434|ovs_rcu(urcu2)|WARN|blocked 1000 ms waiting for pmd73 to quiesce 2022-08-24T07:12:44.313Z|07424|ovs_rcu(ovs-vswitchd)|WARN|blocked 1000 ms waiting for pmd73 to quiesce 2022-08-24T07:12:45.958Z|00435|ovs_rcu(urcu2)|WARN|blocked 1000 ms waiting for pmd73 to quiesce 2022-08-24T07:12:45.964Z|07425|ovs_rcu(ovs-vswitchd)|WARN|blocked 1000 ms waiting for pmd73 to quiesce ...

jinyan-0805 commented 2 years ago

I see the similar issue such as https://github.com/openvswitch/ovs-issues/issues/175 but how can I fix it or is there a workaround ?

jinyan-0805 commented 1 year ago

the pmd73 has a dpdk port ,and the port (dpdk1) is receving packets of bandwidth 1000Mbps，if I add-flows such as the command of "ovs-ofctl add-flow br-int" to add flow, the issue would happend. if stop the traffic, ovs-vswitched will return to normal.

ovs-appctl dpif-netdev/pmd-rxq-show

pmd thread numa_id 0 core_id 5: isolated : true port: dpdk1 queue-id: 1 pmd usage: 96 % port: dpdk13 queue-id: 1 pmd usage: 0 % port: dpdk2 queue-id: 1 pmd usage: 0 % port: dpdk3 queue-id: 1 pmd usage: 0 % port: dpdk4 queue-id: 1 pmd usage: 0 %

igsilya commented 1 year ago

I see the similar issue such as #175 but how can I fix it or is there a workaround ?

The issue #175 is a glibc bug. You need to update your glibc if you see a similar behavior.

igsilya commented 1 year ago

Closing this one as it is a glibc bug.