search

fpgasystems / Coyote

Framework providing operating system abstractions and a range of shared networking (RDMA, TCP/IP) and memory services to common modern heterogeneous platforms.
MIT License
206 stars 62 forks source link

RDMA Server Exits Abruptly #75

Open aaqdas opened 6 days ago

aaqdas commented 6 days ago

I've synthesized the design and ran the hardware on AU-250. It works properly and shows me that I have RDMA Enabled 1 in the dmesg logs and provides me with a MAC and IP.

When I try and run the rdma_server application, the application gives the following output and exits abruptly.

I'm assuming that the device and vfid is the number thats listed in ls -la /dev/fpga_{d}_v{i}. I use the following command to run the rdma_server 

./bin/test -d 0 -i 0

which gives the output

Forking...

Has anyone face anything similar, or is there a bug that needs to be addressed?

JonasDann commented 3 days ago

It is normal that the server forks and runs in the background. Can you not see it running in htop afterwards?

aaqdas commented 2 days ago

It shows up in htop. However, it doesn't generate any logs. I'm assuming it is supposed to generate a log, something similar to what is shown https://github.com/fpgasystems/Coyote/issues/33.

I see that you've updated the documentation for RDMA, which says that I'd need to have FPGAs on both ends.

I am trying to ping between a Mellanox Connect-X6 and RoCE Implementation of Coyote. Is that supported?

aaqdas commented 2 days ago

I have also set up the alternative branch coyote-v1 on my systems. In that branch, the program is killed during the execution of the function ibvQpMap::addQpair and SIGKILL is returned. I've also been debugging it, and it appears to be the problem somewhere at ibvQpMap.cpp:30.