evanmayer
commented
1 year ago Hi @gonesurfing,
Thanks for your bug report.
First off, good job on solving the first USB buffering issue, although I will note that I don't recall doing this on my system. I'm not sure what my Jetpack version is, but I will check. If I saw this error message, I would try --num_samp 131072, halving the number of samples queried from the SDR over USB on each call. I don't think that would solve your buffer filling up issue, though. Let's tackle that, because it will be a real pain in operation if we don't fix it.
You're right that the defaults require tuning. I tuned them on my Jetson Nano 4GB to easily keep the SDR buffers drained, so it's surprising to me that you encountered this warning. Thanks for including debugging output. Can you post the rest of it? If you're shy about posting a lot of output, you can hide it like this:
<details><summary>Details</summary>Looooooong output</details>
gonesurfing
First off, excellent work on this software. I have a remote sensing application in mind, but I'm first trying to get a dry run going.
I'm using a 4gb Jetson Nano, with Jetpack 461.
Probably unrelated, but I first get a crash. Seems the kernel defaults need tuning.
Allocating 15 zero-copy buffers Allocating 15 zero-copy buffers Failed to submit transfer 1 Please increase your allowed usbfs buffer size with the following command: echo 0 > /sys/module/usbcore/parameters/usbfs_memory_mb Failed to submit transfer 0 Please increase your allowed usbfs buffer size with the following command: echo 0 > /sys/module/usbcore/parameters/usbfs_memory_mbrunning this takes care of this error.sudo sh -c 'echo 0 > /sys/module/usbcore/parameters/usbfs_memory_mb'Next, I run this from your README.
python effex/effex/effex.py --time 60 --bandwidth 2.4e6 --frequency 1.4204e9 --num_samp 262144 --resolution 1024 --gain 29.7 --mode spectrum --loglevel=DEBUGNext run starts out ok, but the correlator can't seem to keep up. The queue sizes keep increasing on the SDR buffers. Not sure why this setup would be different than yours, other than I don't have antennas hooked up yet.
2023-01-18 21:33:51,348 - main - DEBUG - State transition: STARTUP to CALIBRATE 2023-01-18 21:33:51,349 - main - DEBUG - SDR buffer 0 size: 0 2023-01-18 21:33:51,349 - main - DEBUG - SDR buffer 1 size: 0 2023-01-18 21:33:51,349 - main - DEBUG - Correlation buffer size: 0 Allocating 15 zero-copy buffers Allocating 15 zero-copy buffers 2023-01-18 21:33:52,537 - main - DEBUG - Starting calibration 2023-01-18 21:33:54,062 - main - INFO - Estimated delay (us): 16253.33074552434 2023-01-18 21:33:54,062 - main - DEBUG - State transition: CALIBRATE to RUN 2023-01-18 21:33:54,063 - main - DEBUG - SDR buffer 0 size: 14 2023-01-18 21:33:54,063 - main - DEBUG - SDR buffer 1 size: 14 2023-01-18 21:33:54,063 - main - DEBUG - Correlation buffer size: 0 2023-01-18 21:33:54,530 - main - DEBUG - SDR buffer 0 size: 18 2023-01-18 21:33:54,531 - main - DEBUG - SDR buffer 1 size: 18 2023-01-18 21:33:54,531 - main - DEBUG - Correlation buffer size: 1 ... 2023-01-18 21:34:00,690 - main - DEBUG - SDR buffer 0 size: 59 2023-01-18 21:34:00,691 - main - DEBUG - SDR buffer 1 size: 59 2023-01-18 21:34:00,698 - main - DEBUG - Correlation buffer size: 2 2023-01-18 21:34:00,721 - main - WARNING - SDR buffer 0 filled up. Data may have been lost! 2023-01-18 21:34:00,722 - main - WARNING - SDR buffer 1 filled up. Data may have been lost! 2023-01-18 21:34:01,151 - main - DEBUG - SDR buffer 0 size: 59 2023-01-18 21:34:01,151 - main - DEBUG - SDR buffer 1 size: 59 2023-01-18 21:34:01,152 - main - DEBUG - Correlation buffer size: 1 2023-01-18 21:34:01,153 - main - WARNING - SDR buffer 0 filled up. Data may have been lost! 2023-01-18 21:34:01,153 - main - WARNING - SDR buffer 1 filled up. Data may have been lost!