Bus error when running test XTRX Pro PCIe with a Jetson Xaver NX

[enjector]

I have installed XTRX pro with a Jetson Xaver using PCIe. All looks good but I get a bus error when I try the test. Any ideas?

$ sudo lspci -v -d 10ee: 0004:01:00.0 Memory controller: Xilinx Corporation Device 7012 Subsystem: Xilinx Corporation Device 0007 Flags: bus master, fast devsel, latency 0, IRQ 554 Memory at 1740010000 (32-bit, non-prefetchable) [size=4K] Memory at 1740000000 (32-bit, non-prefetchable) [size=64K] Capabilities: [40] Power Management version 3 Capabilities: [48] MSI: Enable+ Count=4/16 Maskable- 64bit+ Capabilities: [60] Express Endpoint, MSI 04 Capabilities: [100] Device Serial Number 00-00-00-00-12-34-56-78 Kernel driver in use: xtrx Kernel modules: xtrx

$ sudo ./test_xtrx -t -l2 Master: 32.000 MHz; RX rate: 4.000 MHz; TX rate: 0.000 MHz RX tunned: 900000000.000000 RX bandwidth: 2000000.000000 RX LNA gain: 15.000000 RX PGA gain: 0.000000 RX TIA gain: 9.000000 RX CYCLES=1 SAMPLES=16384 SLICE=16384 (PARTS=1) Bus error

$ dmesg

[ 750.130714] xtrx: call: REGION=1 VMA=ffffffc1736036e0 vma->vm_pgoff=0 [ 750.130861] xtrx: VMA open, virt 7f9c18f000, phys 0 [ 750.130970] xtrx: call: REGION=0 VMA=ffffffc1736034d0 vma->vm_pgoff=1024 [ 750.131087] xtrx: VMA open, virt 7f9c18e000, phys 400000 [ 750.141340] xtrx: ioctl(12345b, 1) [ffffff800bfad000] [ 750.141502] xtrx: 3V3 CTRL:1 [ 750.347480] xtrx: ioctl(12345b, 1) [ffffff800bfad000] [ 750.417835] xtrx: ioctl(12345a, 10000) [ffffff800bfad000] [ 750.417987] xtrx: call: REGION=3 VMA=ffffffc1554b86e0 vma->vm_pgoff=16384 [ 750.418135] xtrx: ioctl(123459, 10000) [ffffff800bfad000] [ 750.418299] Unhandled fault: implementation fault (unsupported exclusive) (0x92000035) at 0x0000007f9c18e008 [ 750.895577] xtrx: VMA close. [ 750.895669] xtrx: VMA close. [ 750.895777] xtrx: 3V3 CTRL:0

[enjector]

I just tried increasing the coherent_pool, but I still got the same problem:

user@user-desktop:/boot/extlinux$ more extlinux.conf TIMEOUT 30 DEFAULT primary

MENU TITLE L4T boot options

LABEL primary MENU LABEL primary kernel LINUX /boot/Image INITRD /boot/initrd APPEND ${cbootargs} quiet vmalloc=512M cma=64M coherent_pool=32M

[enjector]

Looks like I found the problem using gdb ./test_xrtx

In xtrxll_pcie_linux.c:503: this is not supported on the ARM proc:

uint32_t icnt = __atomic_exchange_n((uint32_t*)dev->mmap_stat_buf + XTRX_KERN_MMAP_RX_IRQS,
                                    0, __ATOMIC_SEQ_CST);

Workaround (a kludge!):

uint32_t* p = (uint32_t*) dev->mmap_stat_buf + XTRX_KERN_MMAP_RX_IRQS;
uint32_t icnt = *p;
*p = 0;

Do this for TX on line 642

And now I get a good result:

RX:

$ ./test_xtrx -t -l2 Master: 32.000 MHz; RX rate: 4.000 MHz; TX rate: 0.000 MHz RX tunned: 900000000.000000 RX bandwidth: 2000000.000000 RX LNA gain: 15.000000 RX PGA gain: 0.000000 RX TIA gain: 9.000000 RX CYCLES=1 SAMPLES=16384 SLICE=16384 (PARTS=1) PROCESSED RX SLICE 0 /0: res 0 TS: 8192 4182 us DELTA 61 us LATE 2195 us 16384 samples RX STAT Overruns:0 Success! Processed 1 devs, each: RX 2 x 1.836 = 3.672 MSPS (WIRE: 14.688163) TX 2 x 0.000 = 0.000 MSPS (WIRE: 0.000000 MB/s)

TX:

$ ./test_xtrx -T -l2 Master: 64.000 MHz; RX rate: 0.000 MHz; TX rate: 4.000 MHz TX tunned: 450000000.000000 TX bandwidth: 2000000.000000 TX PAD gain: 0.000000 TX CYCLES=1 SAMPLES=16384 SLICE=16384 (PARTS=1) PROCESSED TX SLICE 0/0: res 0 TS: 0 250 us DELTA 58 us LATE -1739 us 16384 x 1 samples (16384) TX STAT Underruns:0 Success! Processed 1 devs, each: RX 2 x 0.000 = 0.000 MSPS (WIRE: 0.000000) TX 2 x 21.623 = 43.247 MSPS (WIRE: 172.987583 MB/s)

TODO: Need too look at the supported atomic exchange primitives.

[Ech0xing]

Hi, Do we replace the line with your workaround or add below it? and is it line 632?

[Ech0xing]

Also, does line 503-505 need to be uncommented? I cant tell from the instructions above what it should be. Thanks.

[Ech0xing]

Bump....Can anyone help with this?

Thank you!!

[Ech0xing]

@enjector can you help me with this, please? Thanks!!

[enjector]

Hi, just saw your messages. Yes, I had to replace those lines at 503.