LB bus error - Githubissues

m1357 commented 5 years ago

Using intel x520 on freebsd12. lb fails with bus error after initial setup.

OS and patch

FreeBSD 12.0-RELEASE-p7 FreeBSD 12.0-RELEASE-p7 GENERIC amd64

initial state of adapter in dmesg:

ix2: <Intel(R) PRO/10GbE PCI-Express Network Driver> port 0x8020-0x803f mem 0xca080000-0xca0fffff,0xca104000-0xca107fff irq 64 at device 0.0 numa-domain 1 on pci21
ix2: using 2048 tx descriptors and 2048 rx descriptors
ix2: msix_init qsets capped at 16
ix2: pxm cpus: 16 queue msgs: 63 admincnt: 1
ix2: using 16 rx queues 16 tx queues 
ix2: Using MSIX interrupts with 17 vectors
ix2: allocated for 16 queues
ix2: allocated for 16 rx queues
ix2: Ethernet address: ac:1f:6b:2d:f2:3c
ix2: PCI Express Bus: Speed 5.0GT/s Width x8
ix2: netmap queues/slots: TX 16/2048, RX 16/2048
ix2: permanently promiscuous mode enabled
ix2: link state changed to UP

lb startup:

# lb -i ix2 -p bro:5 -o 120 
828.952023 main [588] interface is ix2
829.182952 main [702] successfully opened netmap:ix2 (tx rings: 2048)
829.182971 main [774] opening pipe named netmap:bro{0/xT@1
829.183172 nm_mmap [989] do not mmap, inherit from parent
829.183179 main [789] successfully opened pipe #1 netmap:bro{0/xT@1 (tx slots: 1024)
829.183181 main [794] zerocopy enabled
829.183183 main [774] opening pipe named netmap:bro{1/xT@1
829.183224 nm_mmap [989] do not mmap, inherit from parent
829.183229 main [789] successfully opened pipe #2 netmap:bro{1/xT@1 (tx slots: 1024)
829.183231 main [794] zerocopy enabled
829.183233 main [774] opening pipe named netmap:bro{2/xT@1
829.183273 nm_mmap [989] do not mmap, inherit from parent
829.183277 main [789] successfully opened pipe #3 netmap:bro{2/xT@1 (tx slots: 1024)
829.183279 main [794] zerocopy enabled
829.183281 main [774] opening pipe named netmap:bro{3/xT@1
829.183319 nm_mmap [989] do not mmap, inherit from parent
829.183325 main [789] successfully opened pipe #4 netmap:bro{3/xT@1 (tx slots: 1024)
829.183327 main [794] zerocopy enabled
829.183329 main [774] opening pipe named netmap:bro{4/xT@1
829.183371 nm_mmap [989] do not mmap, inherit from parent
829.183376 main [789] successfully opened pipe #5 netmap:bro{4/xT@1 (tx slots: 1024)
829.183378 main [794] zerocopy enabled

Bus error

dmesg after:

ix2: link state changed to DOWN
pid 3476 (lb), uid 0: exited on signal 10
499.093484 [1220] netmap_free_buf           Cannot free buf#1150976: should be in [2, 1000000[
499.093500 [1220] netmap_free_buf           Cannot free buf#1413120: should be in [2, 1000000[
499.093510 [1220] netmap_free_buf           Cannot free buf#1675264: should be in [2, 1000000[
499.093520 [1220] netmap_free_buf           Cannot free buf#1937408: should be in [2, 1000000[
ix2: link state changed to UP

adapter options:

ix2: flags=289c3<UP,BROADCAST,RUNNING,NOARP,PROMISC,SIMPLEX,MULTICAST,PPROMISC> metric 0 mtu 1500
    options=8038a0<JUMBO_MTU,VLAN_HWCSUM,WOL_UCAST,WOL_MCAST,WOL_MAGIC>

Adapter config

ifconfig_ix2="up -arp -lro -rxcsum -rxcsum6 -txcsum6 -txcsum -tso4 -tso6 -vlanmtu -vlanhwtag -vlanhwfilter -vlanhwtso promisc "

if I restart lb again after the crash it runs but does not bring in new packets and just iterates over the existing buffers.

dmesg shows :

167.000983 [1760] netmap_ring_reinit        called for ix2 RX15
167.000995 [1760] netmap_ring_reinit        called for ix2 RX15
167.001008 [1760] netmap_ring_reinit        called for ix2 RX15
167.001021 [1760] netmap_ring_reinit        called for ix2 RX15
167.001034 [1760] netmap_ring_reinit        called for ix2 RX15
167.001047 [1760] netmap_ring_reinit        called for ix2 RX15
168.000841 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
168.000860 [1760] netmap_ring_reinit        called for ix2 RX15
168.000873 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
168.000890 [1760] netmap_ring_reinit        called for ix2 RX15
168.000902 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
168.000919 [1760] netmap_ring_reinit        called for ix2 RX15
168.000932 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
168.000949 [1760] netmap_ring_reinit        called for ix2 RX15
168.000962 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
168.000979 [1760] netmap_ring_reinit        called for ix2 RX15
168.000992 [1760] netmap_ring_reinit        called for ix2 RX15
168.001004 [1760] netmap_ring_reinit        called for ix2 RX15
168.001017 [1760] netmap_ring_reinit        called for ix2 RX15
168.001030 [1760] netmap_ring_reinit        called for ix2 RX15
168.001043 [1760] netmap_ring_reinit        called for ix2 RX15
169.000846 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
169.000865 [1760] netmap_ring_reinit        called for ix2 RX15
169.000878 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
169.000895 [1760] netmap_ring_reinit        called for ix2 RX15
169.000908 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
169.000925 [1760] netmap_ring_reinit        called for ix2 RX15
169.000938 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
169.000954 [1760] netmap_ring_reinit        called for ix2 RX15
169.000967 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
169.000984 [1760] netmap_ring_reinit        called for ix2 RX15
169.000997 [1760] netmap_ring_reinit        called for ix2 RX15
169.001010 [1760] netmap_ring_reinit        called for ix2 RX15
169.001023 [1760] netmap_ring_reinit        called for ix2 RX15
169.001035 [1760] netmap_ring_reinit        called for ix2 RX15
169.001048 [1760] netmap_ring_reinit        called for ix2 RX15
170.000841 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
170.000860 [1760] netmap_ring_reinit        called for ix2 RX15
170.000873 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
170.000890 [1760] netmap_ring_reinit        called for ix2 RX15
170.000903 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
170.000920 [1760] netmap_ring_reinit        called for ix2 RX15
170.000933 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
170.000950 [1760] netmap_ring_reinit        called for ix2 RX15
170.000962 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
170.000979 [1760] netmap_ring_reinit        called for ix2 RX15
170.000992 [1760] netmap_ring_reinit        called for ix2 RX15
170.001005 [1760] netmap_ring_reinit        called for ix2 RX15
170.001018 [1760] netmap_ring_reinit        called for ix2 RX15
170.001031 [1760] netmap_ring_reinit        called for ix2 RX15
170.001044 [1760] netmap_ring_reinit        called for ix2 RX15
171.000841 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
171.000860 [1760] netmap_ring_reinit        called for ix2 RX15
171.000873 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
171.000890 [1760] netmap_ring_reinit        called for ix2 RX15
171.000903 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
171.000920 [1760] netmap_ring_reinit        called for ix2 RX15
171.000933 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
171.000950 [1760] netmap_ring_reinit        called for ix2 RX15
171.000963 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
171.000979 [1760] netmap_ring_reinit        called for ix2 RX15
171.000992 [1760] netmap_ring_reinit        called for ix2 RX15
171.001005 [1760] netmap_ring_reinit        called for ix2 RX15
171.001018 [1760] netmap_ring_reinit        called for ix2 RX15
171.001031 [1760] netmap_ring_reinit        called for ix2 RX15
171.001044 [1760] netmap_ring_reinit        called for ix2 RX15
172.000845 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
172.000864 [1760] netmap_ring_reinit        called for ix2 RX15
172.000877 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
172.000894 [1760] netmap_ring_reinit        called for ix2 RX15
172.000907 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
172.000924 [1760] netmap_ring_reinit        called for ix2 RX15
172.000937 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
172.000954 [1760] netmap_ring_reinit        called for ix2 RX15
172.000967 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
172.000984 [1760] netmap_ring_reinit        called for ix2 RX15
172.000997 [1760] netmap_ring_reinit        called for ix2 RX15
172.001009 [1760] netmap_ring_reinit        called for ix2 RX15
172.001022 [1760] netmap_ring_reinit        called for ix2 RX15
172.001035 [1760] netmap_ring_reinit        called for ix2 RX15
172.001048 [1760] netmap_ring_reinit        called for ix2 RX15
173.000840 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
173.000859 [1760] netmap_ring_reinit        called for ix2 RX15
173.000873 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
173.000890 [1760] netmap_ring_reinit        called for ix2 RX15
173.000903 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
173.000920 [1760] netmap_ring_reinit        called for ix2 RX15
173.000933 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
173.000950 [1760] netmap_ring_reinit        called for ix2 RX15
173.000962 [1715] nm_rxsync_prologue        ix2 RX15: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
173.000979 [1760] netmap_ring_reinit        called for ix2 RX15
173.000992 [1760] netmap_ring_reinit        called for ix2 RX15
173.001005 [1760] netmap_ring_reinit        called for ix2 RX15
173.001018 [1760] netmap_ring_reinit        called for ix2 RX15
173.001031 [1760] netmap_ring_reinit        called for ix2 RX15
173.001044 [1760] netmap_ring_reinit        called for ix2 RX15

m1357 commented 5 years ago

netmap verbose dmesg output:

684.909537 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909544 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909558 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.909565 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.909567 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909574 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909597 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.909605 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.909607 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.909611 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909618 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909634 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909646 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.909648 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.909652 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909664 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.909672 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.909673 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909681 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909704 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.909704 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.909712 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909726 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.909731 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909745 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.909746 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909754 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909775 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.909782 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.909784 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909791 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909797 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.909807 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909820 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.909832 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.909833 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909840 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909829 [ 957] netmap_dev_pager_ctor     handle 0xfffff82085fb9410 size 343019520 prot 3 foff 0
684.909854 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.909864 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.909866 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909873 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909886 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.909895 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909897 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.909911 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909925 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.909932 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.909935 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.909936 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909943 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909960 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909974 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.909982 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.909983 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.909991 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910018 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.910022 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910030 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910034 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.910039 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910045 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910068 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.910073 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.910074 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910082 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910104 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.910105 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.910113 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.910114 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910127 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.910132 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910139 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910155 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910159 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.910167 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.910181 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.910186 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910199 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.910200 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.910211 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.910213 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910220 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910228 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910241 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.910245 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910253 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910265 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.910274 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910296 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.910297 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.910301 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.910304 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.910305 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910317 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.910320 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910327 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910344 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
bro: Ethernet address: 00:be:d6:c0:f9:00
684.910357 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.910358 [1124] netmap_vp_create          max frame size 1514
684.910368 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.910374 [ 724] nm_mem_assign_group       iommu_group 0
684.910378 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910386 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910386 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.910411 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.910413 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.910415 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910422 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910438 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.910446 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.910452 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.910455 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910462 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910485 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.910487 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.910494 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910501 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910518 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.910521 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.910526 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910531 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.910535 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910547 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.910549 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910556 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910572 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910580 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.910586 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.910589 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910596 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910617 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910626 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910635 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.910641 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.910644 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910652 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910677 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.910681 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.910691 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.910695 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.910698 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.910700 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910706 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910723 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910729 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.910737 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.910738 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910746 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910763 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910773 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.910775 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.910782 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.910783 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910791 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910820 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910828 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910842 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.910859 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.910860 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.910869 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.910870 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910877 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910882 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.910891 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.910894 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910901 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910912 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.910922 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910924 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.910930 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.910938 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910945 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910960 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.910969 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.910971 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910978 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.910982 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.910992 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.911000 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911016 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911023 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.911030 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.911031 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911038 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911041 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.911055 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911070 [1880] netmap_interp_ringid      bro{0: tx [0,1) rx [0,0) id 0
684.911074 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.911077 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911084 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911095 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.911096 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.911104 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911106 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.911120 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911134 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.911142 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.911143 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911151 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911183 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.911190 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.911192 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911200 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911208 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.911217 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911225 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911234 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.911236 [1952] netmap_krings_get         bro{0: grabbing tx [0, 1) rx [0, 0)
684.911243 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.911248 [1896] netmap_mem2_rings_create  NOT creating ring bro{0 RX0 (ring 0, users 0 neekring 0)
684.911257 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911279 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.911281 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911288 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911299 [1896] netmap_mem2_rings_create  NOT creating ring bro{0 RX1 (ring 0, users 0 neekring 0)
684.911312 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.911314 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911314 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.911321 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911328 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.911341 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.911343 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911350 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911360 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.911362 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.911371 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911379 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911391 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.911393 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.911400 [1900] netmap_mem2_rings_create  creating bro{0 TX0
684.911413 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.911424 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.911426 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911433 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911445 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.911449 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911457 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911478 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.911479 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.911485 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.911487 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911494 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911511 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.911518 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.911520 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.911523 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911529 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911557 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.911564 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.911565 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911573 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911595 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.911599 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.911607 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.911608 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.911616 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.911617 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911620 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.911625 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911633 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911641 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911654 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.911681 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911687 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.911689 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.911694 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.911696 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911703 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911717 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911720 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.911731 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.911734 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911741 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911758 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911764 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.911772 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.911773 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911786 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.911794 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.911795 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911808 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.911816 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911829 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.911836 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911842 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.911843 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911850 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911857 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911871 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.911884 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.911885 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911892 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911913 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911927 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.911929 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.911934 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.911936 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911943 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911960 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.911962 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.911969 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911975 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.911992 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.911996 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.911999 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912006 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912018 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.912027 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912050 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.912053 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.912059 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912067 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912068 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.912080 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.912082 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912088 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912108 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.912119 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.912121 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912123 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.912128 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912150 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.912151 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912153 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.912159 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912165 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912183 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.912185 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.912191 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912198 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912215 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.912218 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.912224 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912231 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912238 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912252 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.912265 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.912266 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912274 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912295 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.912304 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912310 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.912319 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912327 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912339 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.912341 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.912353 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.912355 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912363 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912382 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912396 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.912400 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912407 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912424 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912428 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.912431 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.912439 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.912439 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912447 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912461 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912474 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.912477 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912485 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912499 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.912509 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.912510 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912513 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.912518 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912543 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.912549 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.912553 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.912553 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912561 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912576 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.912577 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912585 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912598 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.912600 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912607 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912630 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.912637 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.912639 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912646 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912670 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.912679 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912679 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.912679 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.912696 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912710 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.912710 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.912719 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.912721 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912728 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912751 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.912752 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.912758 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912765 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912780 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912784 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.912797 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912808 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.912810 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.912826 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.912830 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.912835 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912842 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912848 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912861 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.912869 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.912871 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912877 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912916 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.912919 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.912927 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.912928 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912942 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.912943 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912947 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.912956 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.912959 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912965 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912979 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.912988 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.912997 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913010 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.913013 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913020 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913033 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.913033 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.913042 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913043 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.913049 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913057 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913076 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.913079 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.913081 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913089 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913101 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.913104 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913111 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913124 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.913132 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.913134 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913141 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913164 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.913173 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.913175 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913182 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913199 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913213 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.913227 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.913230 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913237 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913246 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913253 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.913262 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913283 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.913286 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.913290 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.913291 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913293 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.913299 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913306 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913313 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.913314 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913323 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913344 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.913351 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.913353 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913360 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913364 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.913375 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913396 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.913397 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.913405 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.913407 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913414 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913424 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.913433 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913451 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913469 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.913474 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.913482 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.913483 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913491 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913515 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.913517 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.913524 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913537 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.913550 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913557 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913563 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.913570 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.913571 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.913573 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913571 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.913580 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913619 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913633 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.913642 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.913649 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.913651 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913656 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.913673 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.913675 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.913676 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913684 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913691 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913700 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913714 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.913718 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913725 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913731 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.913740 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913746 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.913755 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913779 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.913782 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.913788 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913796 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913808 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.913816 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913818 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.913832 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913837 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.913840 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.913847 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913851 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.913854 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913869 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913884 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.913888 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913901 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.913907 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913919 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.913926 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.913928 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913937 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.913941 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.913954 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.913960 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913967 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913973 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.913979 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.913982 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.913990 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914012 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.914012 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.914020 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.914021 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914029 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914046 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914052 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.914060 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.914061 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914074 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.914078 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914086 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914107 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.914116 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914123 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.914132 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914139 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914140 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.914152 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.914159 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.914161 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914168 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914175 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914190 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.914195 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914203 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914222 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.914224 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.914231 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914238 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914251 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.914258 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.914260 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914267 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914290 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.914291 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.914299 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.914300 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914313 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.914324 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.914326 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.914331 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914345 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.914346 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914354 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914371 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914378 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.914378 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914394 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914406 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.914408 [1896] netmap_mem2_rings_create  NOT creating ring bro{0 TX1 (ring 0, users 0 neekring 0)
684.914413 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.914415 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914427 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.914436 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914438 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.914452 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914460 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.914460 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914473 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.914480 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.914482 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914489 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914507 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914515 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.914521 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.914524 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914531 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914539 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914553 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.914555 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914562 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914584 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.914586 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.914592 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914600 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914618 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.914627 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914649 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.914651 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.914653 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.914658 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914665 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914681 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914684 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.914694 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.914697 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914704 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914716 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.914730 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914733 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.914747 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914749 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.914755 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914762 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914788 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.914792 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914802 [1900] netmap_mem2_rings_create  creating bro}0 RX0
684.914811 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.914816 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.914824 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.914826 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914833 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914854 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.914859 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914866 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914873 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.914878 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.914882 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914889 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914910 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.914912 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.914919 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914929 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.914938 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914951 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.914959 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914962 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.914971 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.914978 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.914979 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.914987 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915001 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.915002 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915009 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915023 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.915026 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915033 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915042 [1896] netmap_mem2_rings_create  NOT creating ring bro}0 RX1 (ring 0, users 0 neekring 0)
684.915060 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.915068 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.915069 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915077 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915100 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.915102 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.915109 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915130 [1896] netmap_mem2_rings_create  NOT creating ring bro}0 TX0 (ring 0, users 0 neekring 0)
684.915133 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.915141 [1896] netmap_mem2_rings_create  NOT creating ring bro}0 TX1 (ring 0, users 0 neekring 0)
684.915154 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.915165 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915171 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.915179 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.915180 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915188 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915207 [ 724] nm_mem_assign_group       iommu_group 0
684.915212 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.915214 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.915215 [1880] netmap_interp_ringid      bro{1: tx [0,1) rx [0,0) id 0
684.915223 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915234 [1952] netmap_krings_get         bro{1: grabbing tx [0, 1) rx [0, 0)
684.915244 [1896] netmap_mem2_rings_create  NOT creating ring bro{1 RX0 (ring 0, users 0 neekring 0)
684.915244 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.915256 [1896] netmap_mem2_rings_create  NOT creating ring bro{1 RX1 (ring 0, users 0 neekring 0)
684.915267 [1900] netmap_mem2_rings_create  creating bro{1 TX0
684.915276 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915290 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.915299 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.915300 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915308 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915321 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.915332 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.915335 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915343 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915361 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915376 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.915379 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915384 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.915386 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915393 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915408 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915415 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915428 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.915437 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915451 [1896] netmap_mem2_rings_create  NOT creating ring bro{1 TX1 (ring 0, users 0 neekring 0)
684.915461 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.915463 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.915467 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.915475 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.915476 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.915476 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915484 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915500 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.915504 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.915509 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915517 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915536 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.915540 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.915543 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915550 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915562 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.915571 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915573 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.915587 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915595 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.915598 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.915603 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915612 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915642 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.915650 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.915652 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915659 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915659 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.915674 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915683 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.915692 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.915695 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.915696 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915704 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915720 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915728 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.915734 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.915737 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915749 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.915758 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915769 [1900] netmap_mem2_rings_create  creating bro}1 RX0
684.915781 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.915783 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.915784 [1896] netmap_mem2_rings_create  NOT creating ring bro}1 RX1 (ring 0, users 0 neekring 0)
684.915790 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915799 [1896] netmap_mem2_rings_create  NOT creating ring bro}1 TX0 (ring 0, users 0 neekring 0)
684.915810 [1896] netmap_mem2_rings_create  NOT creating ring bro}1 TX1 (ring 0, users 0 neekring 0)
684.915824 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.915832 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.915834 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915841 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915865 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.915868 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915875 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915881 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.915888 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.915897 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915897 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.915910 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.915913 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915920 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915929 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915950 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.915955 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.915959 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.915962 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915973 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.915975 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915982 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.915995 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.916003 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.916004 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916013 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916042 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.916044 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916044 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.916051 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916059 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.916064 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.916068 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916084 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916092 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916093 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.916100 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916115 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.916125 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.916127 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916134 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916143 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916157 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.916167 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.916175 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.916177 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916184 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916208 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.916217 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.916224 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.916226 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916233 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916234 [ 724] nm_mem_assign_group       iommu_group 0
684.916242 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916256 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.916267 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.916270 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916277 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916293 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916300 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.916307 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.916309 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916316 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916342 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.916349 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916363 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.916367 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916369 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.916374 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916396 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.916400 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.916405 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916419 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.916431 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916447 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916452 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.916454 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916461 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916462 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.916474 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.916481 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.916483 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916496 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.916500 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916507 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916528 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.916533 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.916536 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916543 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916555 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.916564 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916566 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.916580 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916592 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.916605 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.916606 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916605 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.916614 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916622 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916647 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.916653 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916661 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916674 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.916685 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.916688 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916695 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916712 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916718 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.916726 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.916727 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916727 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.916735 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916742 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916760 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.916765 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.916773 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.916775 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916782 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916807 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916819 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.916826 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.916828 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916835 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916850 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.916857 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.916859 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916861 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.916866 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916881 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.916884 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916891 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916894 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.916912 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.916913 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.916919 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.916926 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.916928 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916935 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916962 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.916970 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.916971 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916979 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.916994 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.916998 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917002 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.917005 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917013 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917035 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.917038 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.917047 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.917055 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.917056 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917063 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917085 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.917087 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.917097 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.917098 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917105 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917122 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917129 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.917135 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.917138 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917151 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.917154 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917161 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917184 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.917188 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.917193 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917200 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917208 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917216 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917229 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.917234 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917242 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917261 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.917268 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.917270 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917277 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917291 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.917298 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.917301 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917308 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917337 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.917346 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917359 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.917367 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.917368 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917376 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917401 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917415 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.917417 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.917422 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.917423 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917425 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.917431 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917444 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.917452 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.917458 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.917461 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917468 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917483 [1880] netmap_interp_ringid      bro{2: tx [0,1) rx [0,0) id 0
684.917485 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.917491 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917502 [1952] netmap_krings_get         bro{2: grabbing tx [0, 1) rx [0, 0)
684.917510 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.917513 [1896] netmap_mem2_rings_create  NOT creating ring bro{2 RX0 (ring 0, users 0 neekring 0)
684.917520 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917529 [1896] netmap_mem2_rings_create  NOT creating ring bro{2 RX1 (ring 0, users 0 neekring 0)
684.917544 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.917551 [1900] netmap_mem2_rings_create  creating bro{2 TX0
684.917558 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917577 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917585 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.917590 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.917597 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.917599 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917606 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917613 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917632 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.917643 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917657 [1896] netmap_mem2_rings_create  NOT creating ring bro{2 TX1 (ring 0, users 0 neekring 0)
684.917665 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.917665 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.917668 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.917669 [1900] netmap_mem2_rings_create  creating bro}2 RX0
684.917676 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917684 [1896] netmap_mem2_rings_create  NOT creating ring bro}2 RX1 (ring 0, users 0 neekring 0)
684.917700 [1896] netmap_mem2_rings_create  NOT creating ring bro}2 TX0 (ring 0, users 0 neekring 0)
684.917709 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917723 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.917731 [1896] netmap_mem2_rings_create  NOT creating ring bro}2 TX1 (ring 0, users 0 neekring 0)
684.917744 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.917755 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917775 [ 724] nm_mem_assign_group       iommu_group 0
684.917777 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.917787 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.917789 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917796 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917803 [1880] netmap_interp_ringid      bro{3: tx [0,1) rx [0,0) id 0
684.917819 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.917822 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.917827 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917839 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.917847 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.917849 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.917851 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917858 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917866 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917879 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.917888 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.917890 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917897 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917912 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.917921 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917921 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.917936 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917945 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.917948 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.917957 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.917959 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917966 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917974 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917982 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.917990 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918004 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.918005 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918013 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918029 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918042 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.918049 [1952] netmap_krings_get         bro{3: grabbing tx [0, 1) rx [0, 0)
684.918052 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918060 [1896] netmap_mem2_rings_create  NOT creating ring bro{3 RX0 (ring 0, users 0 neekring 0)
684.918073 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.918077 [1896] netmap_mem2_rings_create  NOT creating ring bro{3 RX1 (ring 0, users 0 neekring 0)
684.918084 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918097 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.918106 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.918106 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918115 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918120 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.918128 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.918129 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918136 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918151 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.918160 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.918161 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918168 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918175 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918189 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.918197 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.918198 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918211 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.918214 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918221 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918242 [1900] netmap_mem2_rings_create  creating bro{3 TX0
684.918244 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.918258 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918270 [1896] netmap_mem2_rings_create  NOT creating ring bro{3 TX1 (ring 0, users 0 neekring 0)
684.918275 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918276 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.918282 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918292 [1900] netmap_mem2_rings_create  creating bro}3 RX0
684.918305 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.918312 [1896] netmap_mem2_rings_create  NOT creating ring bro}3 RX1 (ring 0, users 0 neekring 0)
684.918317 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918326 [1896] netmap_mem2_rings_create  NOT creating ring bro}3 TX0 (ring 0, users 0 neekring 0)
684.918337 [1896] netmap_mem2_rings_create  NOT creating ring bro}3 TX1 (ring 0, users 0 neekring 0)
684.918351 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.918366 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918384 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.918393 [ 724] nm_mem_assign_group       iommu_group 0
684.918393 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918401 [1880] netmap_interp_ringid      bro{4: tx [0,1) rx [0,0) id 0
684.918417 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.918420 [1952] netmap_krings_get         bro{4: grabbing tx [0, 1) rx [0, 0)
684.918426 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918434 [1896] netmap_mem2_rings_create  NOT creating ring bro{4 RX0 (ring 0, users 0 neekring 0)
684.918448 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.918455 [1896] netmap_mem2_rings_create  NOT creating ring bro{4 RX1 (ring 0, users 0 neekring 0)
684.918466 [1900] netmap_mem2_rings_create  creating bro{4 TX0
684.918479 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.918487 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.918489 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918496 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918512 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.918524 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.918530 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918539 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918542 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.918554 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918557 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.918571 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918575 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.918586 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918590 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.918604 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918608 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.918619 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918623 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.918632 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.918634 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918641 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918662 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.918665 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.918668 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.918671 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918678 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918686 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918700 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.918714 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918726 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.918738 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.918745 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.918747 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918754 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918771 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.918773 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.918781 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.918790 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918803 [1896] netmap_mem2_rings_create  NOT creating ring bro{4 TX1 (ring 0, users 0 neekring 0)
684.918804 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.918810 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918813 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
684.918822 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
684.918830 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.918831 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918838 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918854 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918868 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.918876 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.918877 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918885 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918889 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.918900 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918908 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918909 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
684.918915 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918923 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918949 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
684.918952 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918961 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.918979 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
684.918991 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
684.918998 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
684.919000 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.919007 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.919027 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.919062 [1900] netmap_mem2_rings_create  creating bro}4 RX0
684.919082 [1896] netmap_mem2_rings_create  NOT creating ring bro}4 RX1 (ring 0, users 0 neekring 0)
684.919088 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.919098 [1896] netmap_mem2_rings_create  NOT creating ring bro}4 TX0 (ring 0, users 0 neekring 0)
684.919113 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
684.919120 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
684.919122 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.919129 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.919149 [1896] netmap_mem2_rings_create  NOT creating ring bro}4 TX1 (ring 0, users 0 neekring 0)
684.919197 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
684.919200 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.919206 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.919219 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
684.919228 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.919282 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
684.919296 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
684.919301 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.919323 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
684.919324 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.919332 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.919383 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
684.919391 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.919433 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
684.919476 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
684.919484 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
687.045044 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe798
687.045055 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
687.045079 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbe9d8
687.045087 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
687.045110 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbec18
687.045118 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
687.045140 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbee58
687.045148 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
687.045165 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf098
687.045173 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
687.045198 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf2d8
687.045206 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
687.045223 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf518
687.045231 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
687.045270 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf758
687.045278 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
687.045292 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbf998
687.045300 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
687.045315 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfbd8
687.045323 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
687.045338 [1384] nm_os_selwakeup           on knote 0xfffffe017ebbfe18
687.045346 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
687.045366 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0058
687.045373 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
687.045388 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0298
687.045396 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
687.045448 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc04d8
687.045456 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
687.045499 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0718
687.045507 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
687.045524 [1384] nm_os_selwakeup           on knote 0xfffffe017ebc0958
687.045532 [1384] nm_os_selwakeup           on knote 0xfffff8011009a850
687.047109 [1715] nm_rxsync_prologue        ix2 RX13: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
687.047127 [1760] netmap_ring_reinit        called for ix2 RX13
687.048719 [1715] nm_rxsync_prologue        ix2 RX13: fail 'head < kring->nr_hwcur || head > kring->nr_hwtail' h 0 c 0 t 2047 rh 0 rc 0 rt 2047 hc 2047 ht 2047
687.048737 [1760] netmap_ring_reinit        called for ix2 RX13
pid 3455 (lb), uid 0: exited on signal 10
687.049419 [1855] netmap_free_rings         NOT deleting ring bro{0 RX0 (ring 0, users 0 neekring 0)
687.049430 [1855] netmap_free_rings         NOT deleting ring bro{0 RX1 (ring 0, users 0 neekring 0)
687.049441 [1855] netmap_free_rings         NOT deleting ring bro{0 TX0 (ring 0xfffffe01c0690000, users 0 neekring 8)
687.049454 [1855] netmap_free_rings         NOT deleting ring bro{0 TX1 (ring 0, users 0 neekring 0)
687.049464 [1016] netmap_do_unregif         deleting last instance for bro{0
687.049474 [1855] netmap_free_rings         NOT deleting ring bro{0 RX0 (ring 0, users 0 neekring 0)
687.049485 [1855] netmap_free_rings         NOT deleting ring bro{0 RX1 (ring 0, users 0 neekring 0)
687.049495 [1859] netmap_free_rings         deleting ring bro{0 TX0
687.049508 [1855] netmap_free_rings         NOT deleting ring bro{0 TX1 (ring 0, users 0 neekring 0)
687.049519 [1859] netmap_free_rings         deleting ring bro}0 RX0
687.049528 [1855] netmap_free_rings         NOT deleting ring bro}0 RX1 (ring 0, users 0 neekring 0)
687.049538 [1855] netmap_free_rings         NOT deleting ring bro}0 TX0 (ring 0, users 0 neekring 0)
687.049549 [1855] netmap_free_rings         NOT deleting ring bro}0 TX1 (ring 0, users 0 neekring 0)
687.049560 [2053] netmap_mem2_deref         active = 6
687.049568 [1855] netmap_free_rings         NOT deleting ring bro{1 RX0 (ring 0, users 0 neekring 0)
687.049579 [1855] netmap_free_rings         NOT deleting ring bro{1 RX1 (ring 0, users 0 neekring 0)
687.049590 [1855] netmap_free_rings         NOT deleting ring bro{1 TX0 (ring 0xfffffe01c0699000, users 0 neekring 8)
687.049602 [1855] netmap_free_rings         NOT deleting ring bro{1 TX1 (ring 0, users 0 neekring 0)
687.049613 [1016] netmap_do_unregif         deleting last instance for bro{1
687.049622 [1855] netmap_free_rings         NOT deleting ring bro{1 RX0 (ring 0, users 0 neekring 0)
687.049633 [1855] netmap_free_rings         NOT deleting ring bro{1 RX1 (ring 0, users 0 neekring 0)
687.049643 [1859] netmap_free_rings         deleting ring bro{1 TX0
687.049655 [1855] netmap_free_rings         NOT deleting ring bro{1 TX1 (ring 0, users 0 neekring 0)
687.049667 [1859] netmap_free_rings         deleting ring bro}1 RX0
687.049675 [1855] netmap_free_rings         NOT deleting ring bro}1 RX1 (ring 0, users 0 neekring 0)
687.049685 [1855] netmap_free_rings         NOT deleting ring bro}1 TX0 (ring 0, users 0 neekring 0)
687.049696 [1855] netmap_free_rings         NOT deleting ring bro}1 TX1 (ring 0, users 0 neekring 0)
687.049707 [2053] netmap_mem2_deref         active = 5
687.049715 [1855] netmap_free_rings         NOT deleting ring bro{2 RX0 (ring 0, users 0 neekring 0)
687.049725 [1855] netmap_free_rings         NOT deleting ring bro{2 RX1 (ring 0, users 0 neekring 0)
687.049736 [1855] netmap_free_rings         NOT deleting ring bro{2 TX0 (ring 0xfffffe01c06a2000, users 0 neekring 8)
687.049748 [1855] netmap_free_rings         NOT deleting ring bro{2 TX1 (ring 0, users 0 neekring 0)
687.049759 [1016] netmap_do_unregif         deleting last instance for bro{2
687.049768 [1855] netmap_free_rings         NOT deleting ring bro{2 RX0 (ring 0, users 0 neekring 0)
687.049778 [1855] netmap_free_rings         NOT deleting ring bro{2 RX1 (ring 0, users 0 neekring 0)
687.049789 [1859] netmap_free_rings         deleting ring bro{2 TX0
687.049801 [1855] netmap_free_rings         NOT deleting ring bro{2 TX1 (ring 0, users 0 neekring 0)
687.049812 [1859] netmap_free_rings         deleting ring bro}2 RX0
687.049820 [1855] netmap_free_rings         NOT deleting ring bro}2 RX1 (ring 0, users 0 neekring 0)
687.049831 [1855] netmap_free_rings         NOT deleting ring bro}2 TX0 (ring 0, users 0 neekring 0)
687.049841 [1855] netmap_free_rings         NOT deleting ring bro}2 TX1 (ring 0, users 0 neekring 0)
687.049853 [2053] netmap_mem2_deref         active = 4
687.049860 [1855] netmap_free_rings         NOT deleting ring bro{3 RX0 (ring 0, users 0 neekring 0)
687.049871 [1855] netmap_free_rings         NOT deleting ring bro{3 RX1 (ring 0, users 0 neekring 0)
687.049881 [1855] netmap_free_rings         NOT deleting ring bro{3 TX0 (ring 0xfffffe01c06ab000, users 0 neekring 8)
687.049894 [1855] netmap_free_rings         NOT deleting ring bro{3 TX1 (ring 0, users 0 neekring 0)
687.049904 [1016] netmap_do_unregif         deleting last instance for bro{3
687.049913 [1855] netmap_free_rings         NOT deleting ring bro{3 RX0 (ring 0, users 0 neekring 0)
687.049924 [1855] netmap_free_rings         NOT deleting ring bro{3 RX1 (ring 0, users 0 neekring 0)
687.049934 [1859] netmap_free_rings         deleting ring bro{3 TX0
687.049947 [1855] netmap_free_rings         NOT deleting ring bro{3 TX1 (ring 0, users 0 neekring 0)
687.049959 [1859] netmap_free_rings         deleting ring bro}3 RX0
687.049967 [1855] netmap_free_rings         NOT deleting ring bro}3 RX1 (ring 0, users 0 neekring 0)
687.049978 [1855] netmap_free_rings         NOT deleting ring bro}3 TX0 (ring 0, users 0 neekring 0)
687.049988 [1855] netmap_free_rings         NOT deleting ring bro}3 TX1 (ring 0, users 0 neekring 0)
687.050000 [2053] netmap_mem2_deref         active = 3
687.050007 [1108] netmap_close              dev 0xfffff820801a2000 fflag 0x20003 devtype 8192 td 0xfffff820c62fd580
687.050021 [1855] netmap_free_rings         NOT deleting ring bro{4 RX0 (ring 0, users 0 neekring 0)
687.050031 [1855] netmap_free_rings         NOT deleting ring bro{4 RX1 (ring 0, users 0 neekring 0)
687.050042 [1855] netmap_free_rings         NOT deleting ring bro{4 TX0 (ring 0xfffffe01c06b4000, users 0 neekring 8)
687.050054 [1855] netmap_free_rings         NOT deleting ring bro{4 TX1 (ring 0, users 0 neekring 0)
687.050065 [1016] netmap_do_unregif         deleting last instance for bro{4
687.050074 [1855] netmap_free_rings         NOT deleting ring bro{4 RX0 (ring 0, users 0 neekring 0)
687.050085 [1855] netmap_free_rings         NOT deleting ring bro{4 RX1 (ring 0, users 0 neekring 0)
687.050096 [1859] netmap_free_rings         deleting ring bro{4 TX0
687.050103 [1220] netmap_free_buf           Cannot free buf#397312: should be in [2, 163840[
687.050113 [1220] netmap_free_buf           Cannot free buf#471040: should be in [2, 163840[
687.050123 [1220] netmap_free_buf           Cannot free buf#544768: should be in [2, 163840[
687.050133 [1220] netmap_free_buf           Cannot free buf#618496: should be in [2, 163840[
687.050147 [1855] netmap_free_rings         NOT deleting ring bro{4 TX1 (ring 0, users 0 neekring 0)
687.050159 [1859] netmap_free_rings         deleting ring bro}4 RX0
687.050167 [1855] netmap_free_rings         NOT deleting ring bro}4 RX1 (ring 0, users 0 neekring 0)
687.050178 [1855] netmap_free_rings         NOT deleting ring bro}4 TX0 (ring 0, users 0 neekring 0)
687.050188 [1855] netmap_free_rings         NOT deleting ring bro}4 TX1 (ring 0, users 0 neekring 0)
687.050199 [2053] netmap_mem2_deref         active = 2
687.050410 [ 973] netmap_dev_pager_dtor     handle 0xfffff82085fb9410
687.162645 [1859] netmap_free_rings         deleting ring ix2 RX0
687.162665 [1859] netmap_free_rings         deleting ring ix2 RX1
687.162683 [1859] netmap_free_rings         deleting ring ix2 RX2
687.162700 [1859] netmap_free_rings         deleting ring ix2 RX3
687.162718 [1859] netmap_free_rings         deleting ring ix2 RX4
687.162735 [1859] netmap_free_rings         deleting ring ix2 RX5
687.162751 [1859] netmap_free_rings         deleting ring ix2 RX6
687.162768 [1859] netmap_free_rings         deleting ring ix2 RX7
687.162784 [1859] netmap_free_rings         deleting ring ix2 RX8
687.162801 [1859] netmap_free_rings         deleting ring ix2 RX9
687.162817 [1859] netmap_free_rings         deleting ring ix2 RX10
687.162833 [1859] netmap_free_rings         deleting ring ix2 RX11
687.162850 [1859] netmap_free_rings         deleting ring ix2 RX12
687.162867 [1859] netmap_free_rings         deleting ring ix2 RX13
687.162883 [1859] netmap_free_rings         deleting ring ix2 RX14
687.162900 [1859] netmap_free_rings         deleting ring ix2 RX15
687.162916 [1855] netmap_free_rings         NOT deleting ring ix2 RX16 (ring 0, users 0 neekring 0)
687.162927 [1859] netmap_free_rings         deleting ring ix2 TX0
687.162944 [1859] netmap_free_rings         deleting ring ix2 TX1
687.162961 [1859] netmap_free_rings         deleting ring ix2 TX2
687.162978 [1859] netmap_free_rings         deleting ring ix2 TX3
687.162995 [1859] netmap_free_rings         deleting ring ix2 TX4
687.163011 [1859] netmap_free_rings         deleting ring ix2 TX5
687.163028 [1859] netmap_free_rings         deleting ring ix2 TX6
687.163044 [1859] netmap_free_rings         deleting ring ix2 TX7
687.163061 [1859] netmap_free_rings         deleting ring ix2 TX8
687.163077 [1859] netmap_free_rings         deleting ring ix2 TX9
687.163094 [1859] netmap_free_rings         deleting ring ix2 TX10
687.163110 [1859] netmap_free_rings         deleting ring ix2 TX11
687.163127 [1859] netmap_free_rings         deleting ring ix2 TX12
687.163143 [1859] netmap_free_rings         deleting ring ix2 TX13
687.163160 [1859] netmap_free_rings         deleting ring ix2 TX14
687.163176 [1859] netmap_free_rings         deleting ring ix2 TX15
687.163193 [1855] netmap_free_rings         NOT deleting ring ix2 TX16 (ring 0, users 0 neekring 0)
687.163204 [1016] netmap_do_unregif         deleting last instance for ix2
687.163621 [2053] netmap_mem2_deref         active = 1
ix2: link state changed to UP

m1357 commented 5 years ago

output of lb. It seems to fill ring buffers and never overwrite: ./lb -i ix2 -p bro:5 -o 20 367.110672 main [588] interface is ix2 367.355240 main [702] successfully opened netmap:ix2 (tx rings: 2048) 367.355297 main [774] opening pipe named netmap:bro{0/xT@1 367.356246 nm_mmap [984] do not mmap, inherit from parent 367.356266 main [789] successfully opened pipe #1 netmap:bro{0/xT@1 (tx slots: 1024) 367.356270 main [794] zerocopy enabled 367.356273 main [774] opening pipe named netmap:bro{1/xT@1 367.357182 nm_mmap [984] do not mmap, inherit from parent 367.357189 main [789] successfully opened pipe #2 netmap:bro{1/xT@1 (tx slots: 1024) 367.357190 main [794] zerocopy enabled 367.357192 main [774] opening pipe named netmap:bro{2/xT@1 367.357497 nm_mmap [984] do not mmap, inherit from parent 367.357504 main [789] successfully opened pipe #3 netmap:bro{2/xT@1 (tx slots: 1024) 367.357505 main [794] zerocopy enabled 367.357507 main [774] opening pipe named netmap:bro{3/xT@1 367.358772 nm_mmap [984] do not mmap, inherit from parent 367.358794 main [789] successfully opened pipe #4 netmap:bro{3/xT@1 (tx slots: 1024) 367.358798 main [794] zerocopy enabled 367.358801 main [774] opening pipe named netmap:bro{4/xT@1 367.360992 nm_mmap [984] do not mmap, inherit from parent 367.361000 main [789] successfully opened pipe #5 netmap:bro{4/xT@1 (tx slots: 1024) 367.361002 main [794] zerocopy enabled {"ts":1564597389.055264,"interface":"netmap:bro{0/xT@1","output_ring":0,"packets_forwarded":1023,"packets_dropped":1396555,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":517.0170,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":74.7430,"overflow_queue_size":0} {"ts":1564597389.055264,"interface":"netmap:bro{1/xT@1","output_ring":1,"packets_forwarded":1023,"packets_dropped":2023168,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":618.4029,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":88.0360,"overflow_queue_size":0} {"ts":1564597389.055264,"interface":"netmap:bro{2/xT@1","output_ring":2,"packets_forwarded":1023,"packets_dropped":4607744,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":674.2877,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":234.0130,"overflow_queue_size":0} {"ts":1564597389.055264,"interface":"netmap:bro{3/xT@1","output_ring":3,"packets_forwarded":1023,"packets_dropped":2332345,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":625.8625,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":91.8940,"overflow_queue_size":0} {"ts":1564597389.055264,"interface":"netmap:bro{4/xT@1","output_ring":4,"packets_forwarded":1023,"packets_dropped":5472301,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":1021.6357,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":280.0600,"overflow_queue_size":0} {"ts":1564597389.055264,"interface":"netmap:ix2","output_ring":null,"packets_received":16665359,"packets_forwarded":5115,"packets_dropped":15832113,"non_ip_packets":563,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":3457.2058,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":768.7460,"free_buffer_slots":0} {"ts":1564597409.827841,"interface":"netmap:bro{0/xT@1","output_ring":0,"packets_forwarded":1023,"packets_dropped":3331539,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":0.0000,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":0.0000,"overflow_queue_size":0} {"ts":1564597409.827841,"interface":"netmap:bro{1/xT@1","output_ring":1,"packets_forwarded":1023,"packets_dropped":4773191,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":0.0000,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":0.0000,"overflow_queue_size":0} {"ts":1564597409.827841,"interface":"netmap:bro{2/xT@1","output_ring":2,"packets_forwarded":1023,"packets_dropped":8756689,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":0.0000,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":0.0000,"overflow_queue_size":0} {"ts":1564597409.827841,"interface":"netmap:bro{3/xT@1","output_ring":3,"packets_forwarded":1023,"packets_dropped":4108550,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":0.0000,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":0.0000,"overflow_queue_size":0} {"ts":1564597409.827841,"interface":"netmap:bro{4/xT@1","output_ring":4,"packets_forwarded":1023,"packets_dropped":10881016,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":0.0000,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":0.0000,"overflow_queue_size":0} {"ts":1564597409.827841,"interface":"netmap:ix2","output_ring":null,"packets_received":31856100,"packets_forwarded":5115,"packets_dropped":31850985,"non_ip_packets":1119,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":0.0000,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":0.0000,"free_buffer_slots":0} {"ts":1564597431.100699,"interface":"netmap:bro{0/xT@1","output_ring":0,"packets_forwarded":1023,"packets_dropped":3331539,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":0.0000,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":0.0000,"overflow_queue_size":0} {"ts":1564597431.100699,"interface":"netmap:bro{1/xT@1","output_ring":1,"packets_forwarded":1023,"packets_dropped":4773191,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":0.0000,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":0.0000,"overflow_queue_size":0} {"ts":1564597431.100699,"interface":"netmap:bro{2/xT@1","output_ring":2,"packets_forwarded":1023,"packets_dropped":8756689,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":0.0000,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":0.0000,"overflow_queue_size":0} {"ts":1564597431.100699,"interface":"netmap:bro{3/xT@1","output_ring":3,"packets_forwarded":1023,"packets_dropped":4108550,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":0.0000,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":0.0000,"overflow_queue_size":0} {"ts":1564597431.100699,"interface":"netmap:bro{4/xT@1","output_ring":4,"packets_forwarded":1023,"packets_dropped":10881016,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":0.0000,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":0.0000,"overflow_queue_size":0} {"ts":1564597431.100699,"interface":"netmap:ix2","output_ring":null,"packets_received":31856100,"packets_forwarded":5115,"packets_dropped":31850985,"non_ip_packets":1119,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":0.0000,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":0.0000,"free_buffer_slots":0} {"ts":1564597452.297988,"interface":"netmap:bro{0/xT@1","output_ring":0,"packets_forwarded":1023,"packets_dropped":3331539,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":0.0000,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":0.0000,"overflow_queue_size":0} {"ts":1564597452.297988,"interface":"netmap:bro{1/xT@1","output_ring":1,"packets_forwarded":1023,"packets_dropped":4773191,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":0.0000,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":0.0000,"overflow_queue_size":0} {"ts":1564597452.297988,"interface":"netmap:bro{2/xT@1","output_ring":2,"packets_forwarded":1023,"packets_dropped":8756689,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":0.0000,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":0.0000,"overflow_queue_size":0} {"ts":1564597452.297988,"interface":"netmap:bro{3/xT@1","output_ring":3,"packets_forwarded":1023,"packets_dropped":4108550,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":0.0000,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":0.0000,"overflow_queue_size":0} {"ts":1564597452.297988,"interface":"netmap:bro{4/xT@1","output_ring":4,"packets_forwarded":1023,"packets_dropped":10881016,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":0.0000,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":0.0000,"overflow_queue_size":0} {"ts":1564597452.297988,"interface":"netmap:ix2","output_ring":null,"packets_received":31856100,"packets_forwarded":5115,"packets_dropped":31850985,"non_ip_packets":1119,"data_forward_rate_Mbps":0.0000,"data_drop_rate_Mbps":0.0000,"packet_forward_rate_kpps":0.0000,"packet_drop_rate_kpps":0.0000,"free_buffer_slots":0} ^C5115 packets forwarded. 31850985 packets dropped. Total 31856100 456.551061 free_buffers [375] added 0 buffers to netmap free list

m1357 commented 5 years ago

on looking into this further it seems the source from here and the code used in Freebsd 11 and 12 is incompatible after commit 8c69a48711074113d0494da212ce7f8e32c4441b (as far as I can tell). lb runs properly using this commit.

giuseppelettieri commented 5 years ago

That is strange, since that commit is about a patch for a linux driver which should not affect FreeBSD in any way.

m1357 commented 5 years ago

there are probably further commits that work but I know for certain that that commit works. I haven't had the time to test further.

luigirizzo / netmap

LB bus error #635