ib device rex0 not found even though i load the rdma_rxe , and the sh:echo: I/O error

[btlcmr0702]

hi,i followed the step to finish configuration of SoftRoCE , but i met some problems i can't fix.

1. the problem abt I/O error? btl@ubuntu:~$ sudo rxe_cfg start sh: echo: I/O error sh: echo: I/O error sh: echo: I/O error sh: echo: I/O error Use of uninitialized value $rmtu in string at /bin/rxe_cfg line 371. Name Link Driver Speed NMTU IPv4_addr RDEV RMTU
   eth0 yes e1000 1500 114.212.22.35 rxe0

2.i can't add device because the I/O error btl@ubuntu:~$ sudo rxe_cfg add enp5s0 sh: echo: I/O error

3.i have rxe0 device, but it says IB device rxe0 not found btl@ubuntu:~$ sudo rxe_cfg status Use of uninitialized value $rmtu in string at /bin/rxe_cfg line 371. Name Link Driver Speed NMTU IPv4_addr RDEV RMTU
eth0 yes e1000 1500 114.212.22.35 rxe0
btl@ubuntu:~$ ibv_devices libibverbs: Warning: couldn't load driver 'rxe': librxe-rdmav2.so: cannot open shared object file: No such file or directory libibverbs: Warning: no userspace device-specific driver found for /sys/class/infiniband_verbs/uverbs0 device node GUID

---

---

here are some info abt my configuration btl@ubuntu:~$ ls /sys/class/infiniband rxe0 btl@ubuntu:~$ lsmod | grep rxe rdma_rxe 102400 0 ip6_udp_tunnel 16384 1 rdma_rxe udp_tunnel 16384 1 rdma_rxe ib_core 208896 6 rdma_cm,ib_cm,iw_cm,ib_uverbs,rdma_rxe,rdma_ucm btl@ubuntu:~$ uname -r 4.7.0-rc3+

---

i will wait for some replies, thank u ~

[monis410]

please uninstall and than install librxe-dev and let me know what happens Make sure you have the latest code (head should be 227e3c49b6e423c066e1e1887fe30c8261f63cbd)

[btlcmr0702]

hi,thank u for the replies i check out the version and it is the latest code btl@ubuntu:~/librxe-dev$ git log commit 227e3c49b6e423c066e1e1887fe30c8261f63cbd

and then i delete the old librxe-dev , install a new one by git clone https://github.com/SoftRoCE/librxe-dev.git but it seems doesn't work, the problem will happen just like before

[monis410]

Hi any chance that we schedule an online session? we can do it with google hangout

thanks

[btlcmr0702]

wow,really thank u :) i didn't think this problem would be so troublesome that need a session. if it is convenient to u,maybe we can have a session tomorrow and i will inform u in advance.

[monis410]

sure, please coordinate via email monis@mellanox.com

[btlcmr0702]

ok, i have send a request on hangout , if u r free u could accept it and we can have a session

[monis410]

I received the invitation but it is unfortunately in a language I don't speak (Chinese?). Can you please send me an email from your private mail account to which I can reply?

[mcfatealan]

Met the same problem today. I tried to copy /usr/lib64/librxe-rdmav2.so to /usr/lib/librxe-rdmav2.so, and the problem seemed to be solved?

[sbates130272]

Hi

I am confirming a similar issue. The librxe* files are getting installed in /usr/lib64 and I think they need to be installed in /usr/lib on certain systems. If I copy or symlink the files over then things work great for me!

Stephen

[mcfatealan]

@sbates130272 seems still having problems even walking around this issue?

[sbates130272]

No. If I copy or symlink the files over then everything works well.