ido / libvma-old

Automatically exported from code.google.com/p/libvma
Other
0 stars 1 forks source link

RDMAV_HUGEPAGES_SAFE set after ibv_fork_init() #8

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
Commit 0f4c81655332f94313020e667158bc56b983a4b4 "issue: 365538 Loading VMA with 
Redis server give a seg-fault" has moved setting RDMAV_HUGEPAGES_SAFE=1 to 
do_global_ctors() which occurs after ibv_fork_init() has run in main_init().  
This causes ibv_reg_mr() to fail when running with Huge Pages.

# LD_PRELOAD=/usr/lib64/libvma.so.6.5.9 ./timestamping eth4 SO_TIMESTAMPNS 
SOF_TIMESTAMPING_RX_SOFTWARE SOF_TIMESTAMPING_SOFTWARE
 VMA INFO   : ---------------------------------------------------------------------------
 VMA INFO   : VMA_VERSION: 6.5.9-0 Development Snapshot built on Jan 29 2014 14:06:15
 VMA INFO   : Cmd Line: ./timestamping eth4 SO_TIMESTAMPNS SOF_TIMESTAMPING_RX_SOFTWARE SOF_TIMESTAMPING_SOFTWARE
 VMA INFO   : Current Time: Wed Jan 29 14:06:36 2014
 VMA INFO   : Pid: 29456
sh: ofed_info: command not found
 VMA INFO   : OFED Version:  VMA INFO   : Architecture: x86_64
 VMA INFO   : Node: berbox13
 VMA INFO   : ---------------------------------------------------------------------------
 VMA INFO   : Log Level                      3                          [VMA_TRACELEVEL]
 VMA INFO   : ---------------------------------------------------------------------------
calling ibv_fork_init()
Setting RDMAV_HUGEPAGES_SAFE
 VMA WARNING: ib_ctx_collection88:mem_reg_on_all_devices() Failure in mem_reg: addr=0x2aaaaac00000, length=361600063, mr_pos=0, mr_array[mr_pos]=0, dev=0x700080, ibv_dev=mlx4_0
 VMA WARNING: bpool[0x702f40]:247:register_memory() Failed registering memory, This might happen due to low MTT entries. Please refer to README.txt for more info

Original issue reported on code.google.com by shawn.bo...@gmail.com on 29 Jan 2014 at 8:32

GoogleCodeExporter commented 9 years ago
Thanks, i will fix this.

Original comment by orkmella...@gmail.com on 1 Feb 2014 at 9:01

GoogleCodeExporter commented 9 years ago
fixed.

https://code.google.com/p/libvma/source/detail?r=af330d4e464c2482d30a605e324e493
cc7d1586a

https://code.google.com/p/libvma/source/detail?r=b8f41e456c1d9d6ddac0cd9ea9d74fb
214fc3800

Original comment by orkmella...@gmail.com on 2 Feb 2014 at 11:52