search

SoftRoCE / rxe-dev

Development Repository for RXE
Other
128 stars 55 forks source link

Kernel warning trace while handle DMA within RXE #38

Closed Kamalheib closed 4 years ago

Kamalheib commented 9 years ago

I got the following kernel warning after install the kernel with debug flags.

To reproduce: 1- Server: ucmatose 2- Client: ucmatose -s 3- Check dmesg for the following warning

[  235.091672] WARNING: CPU: 1 PID: 2873 at lib/dma-debug.c:601     debug_dma_assert_idle+0x198/0x210()
[  235.091674] mlx4_core 0000:00:07.0: DMA-API: cpu touching an active dma mapped cacheline     [cln=0x000000001f405880]
[  235.092834] Modules linked in: ib_rxe rdma_ucm rdma_cm iw_cm ib_cm ib_uverbs ib_sa ib_mad     ib_core mlx4_en ib_addr mlx4_core vxlan ip6_udp_tunnel udp_tunnel ptp pps_core nfsv3     rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache cfg80211 rfkill sg dm_mirror dm_region_hash     dm_log dm_mod ppdev snd_hda_codec_generic snd_hda_intel snd_hda_controller snd_hda_codec     snd_hda_core snd_hwdep kvm_intel snd_seq kvm snd_seq_device snd_pcm snd_timer     virtio_balloon snd pcspkr serio_raw i2c_piix4 soundcore parport_pc parport acpi_cpufreq nfsd     auth_rpcgss nfs_acl lockd grace sunrpc uinput ext4 mbcache jbd2 ata_generic pata_acpi virtio_blk     virtio_net cirrus syscopyarea sysfillrect sysimgblt drm_kms_helper ttm drm ata_piix libata virtio_pci     virtio_ring i2c_core virtio floppy [last unloaded: mlx4_ib]
[  235.092840] CPU: 1 PID: 2873 Comm: bash Not tainted 4.0.0+ #1
[  235.092841] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS Bochs 01/01/2011
[  235.092845]  0000000000000000 00000000576081c5 ffff8807d3b9bb98 ffffffff8174e720
[  235.092847]  0000000000000000 ffff8807d3b9bbf0 ffff8807d3b9bbd8 ffffffff8108ad9a
[  235.092848]  ffff8800badf1a40 ffff8807e2e55a80 ffff8807e82abaf0 00007fc29680ba00
[  235.092849] Call Trace:
[  235.092856]  [<ffffffff8174e720>] dump_stack+0x4c/0x65
[  235.092860]  [<ffffffff8108ad9a>] warn_slowpath_common+0x8a/0xc0
[  235.092863]  [<ffffffff8108ae25>] warn_slowpath_fmt+0x55/0x70
[  235.092866]  [<ffffffff810e921d>] ? trace_hardirqs_on+0xd/0x10
[  235.092869]  [<ffffffff813bd7b8>] debug_dma_assert_idle+0x198/0x210
[  235.092871]  [<ffffffff811fd5e9>] wp_page_copy.isra.47+0xa9/0x4c0
[  235.092872]  [<ffffffff811ff1c6>] ? do_wp_page+0x86/0x500
[  235.092874]  [<ffffffff811ff1df>] do_wp_page+0x9f/0x500
[  235.092875]  [<ffffffff8120103e>] ? handle_mm_fault+0x56e/0x17b0
[  235.092877]  [<ffffffff81201763>] handle_mm_fault+0xc93/0x17b0
[  235.092879]  [<ffffffff810ea6af>] ? __lock_is_held+0x5f/0x90
[  235.092883]  [<ffffffff81074f8e>] __do_page_fault+0x1ae/0x470
[  235.092886]  [<ffffffff81165196>] ? __audit_syscall_exit+0x1e6/0x280
[  235.092888]  [<ffffffff81075342>] trace_do_page_fault+0x72/0x450
[  235.092903]  [<ffffffff8139a3d4>] ? trace_hardirqs_off_thunk+0x17/0x19
[  235.092906]  [<ffffffff8106ee7e>] do_async_page_fault+0x1e/0xe0
[  235.092908]  [<ffffffff8175aa18>] async_page_fault+0x28/0x30
[  235.092910] ---[ end trace 0ebbc9d6a84fcf81 ]---
[  235.092910] Mapped at:
[  235.092912]  [<ffffffff813bb92c>] debug_dma_map_sg+0x12c/0x150
[  235.092937]  [<ffffffffa0672da7>] ib_umem_get+0x457/0x4f0 [ib_core]
[  235.092941]  [<ffffffffa06e8469>] rxe_mem_init_user+0x49/0x270 [ib_rxe]
[  235.092944]  [<ffffffffa06e4b4e>] rxe_reg_user_mr+0x9e/0x130 [ib_rxe]
[  235.092948]  [<ffffffffa0583901>] ib_uverbs_reg_mr+0x171/0x3c0 [ib_uverbs]