mwrnd / innova2_flex_xcku15p_notes

Nvidia/Mellanox Innova-2 Flex Open Programmable SmartNIC Setup and Usage Notes for XCKU15P FPGA Development
BSD 2-Clause "Simplified" License
49 stars 8 forks source link

FPGA Not Appearing after Rescan #6

Closed doihead closed 1 year ago

doihead commented 1 year ago

I've been able to follow your tutorial and build a bitstream with and have it show up when I do lspci and now I'm trying to remove and reenumerate the FPGA so I can flash a new bitstream without having to restart my computer. When I remove the FPGA by running echo 1 > /sys/bus/pci/devices/0000\:03\:00.0/remove, everything works as I'd expect it to, with the Xilinx RAM device disappearing, but when I try and rescan the bus without doing anything in between using echo 1 > /sys/bus/pci/rescan, it doesn't show up in lspci. I have to reboot the computer before the FPGA shows up again. This procedure works when I attempt to remove and reenumerate other parts of the card like the Ethernet controllers or the PCIe switches, just not for the FPGA. So far I have tried removing all PCIe devices associated with the Innova-2 Flex NIC before rescanning and the steps you listed for disabling and reenabling the PCIe switch with no luck. Do you have any suggestions for what's going on and is there any information I can provide? Thanks!

mwrnd commented 1 year ago

This has been answered in the Innova 2 FPGA PCIE Rescan Not Showing Up thread on the Nvidia Developer Forums.

I have added the innova2_xdma_demo project which includes detailed instructions and demonstration files for Loading Updated Designs Using JTAG. It works on my Intel B360 system running Ubuntu 20.04 and Linux Kernel 5.8.0-43-generic.