RuntimeError: Couldn't load custom C++ ops.

[mmmstew]

I get the following error when running on Jetson Orin Nano development kit:

user@user-orin:~/YOLOv8-DeepSORT-Object-Tracking/ultralytics/yolo/v8/detect$ python predict.py model=yolov8l.pt source="test3.mp4" show=True /usr/local/lib/python3.8/dist-packages/torchvision-0.15.1a0+42759b1-py3.8-linux-aarch64.egg/torchvision/io/image.py:13: UserWarning: Failed to load image Python extension: '/usr/local/lib/python3.8/dist-packages/torchvision-0.15.1a0+42759b1-py3.8-linux-aarch64.egg/torchvision/image.so: undefined symbol: _ZN5torch3jit17parseSchemaOrNameERKNSt7cxx1112basic_stringIcSt11char_traitsIcESaIcEEE'If you don't plan on using image functionality from torchvision.io, you can ignore this warning. Otherwise, there might be something wrong with your environment. Did you have libjpeg or libpng installed before building torchvision from source? warn( [2023-07-22 14:57:40,246][root.tracker][INFO] - Loading weights from deep_sort_pytorch/deep_sort/deep/checkpoint/ckpt.t7... Done! Ultralytics YOLOv8.0.3 🚀 Python-3.8.10 torch-2.0.1 CPU Fusing layers... YOLOv8l summary: 268 layers, 43668288 parameters, 0 gradients, 165.2 GFLOPs Error executing job with overrides: ['model=yolov8l.pt', 'source=test3.mp4', 'show=True'] Traceback (most recent call last): File "predict.py", line 253, in predict predictor() File "/home/user/.local/lib/python3.8/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context return func(*args, **kwargs) File "/home/user/YOLOv8-DeepSORT-Object-Tracking/ultralytics/yolo/engine/predictor.py", line 183, in call preds = self.postprocess(preds, im, im0s) File "predict.py", line 181, in postprocess preds = ops.non_max_suppression(preds, File "/home/user/YOLOv8-DeepSORT-Object-Tracking/ultralytics/yolo/utils/ops.py", line 212, in non_max_suppression i = torchvision.ops.nms(boxes, scores, iou_thres) # NMS File "/usr/local/lib/python3.8/dist-packages/torchvision-0.15.1a0+42759b1-py3.8-linux-aarch64.egg/torchvision/ops/boxes.py", line 40, in nms _assert_has_ops() File "/usr/local/lib/python3.8/dist-packages/torchvision-0.15.1a0+42759b1-py3.8-linux-aarch64.egg/torchvision/extension.py", line 48, in _assert_has_ops raise RuntimeError( RuntimeError: Couldn't load custom C++ ops. This can happen if your PyTorch and torchvision versions are incompatible, or if you had errors while compiling torchvision from source. For further information on the compatible versions, check https://github.com/pytorch/vision#installation for the compatibility matrix. Please check your PyTorch version with torch.version and your torchvision version with torchvision.version__ and verify if they are compatible, and if not please reinstall torchvision so that it matches your PyTorch install.

Set the environment variable HYDRA_FULL_ERROR=1 for a complete stack trace.

I have checked the Runtime error suggetion following the link https://github.com/pytorch/vision#installation and the following versions should be compatible:

• Python 3.8.10
• pytorch 2.0.1
• torchvision 0.15.1a0+42759b1

[mmmstew]

As pytorch was not installed with CUDA, I uninstalled and corrected this. Now I have: pytorch 2.0.0+nv23.05 torchvision 0.15.1a0+42759b1

Now I have the following error:

user@user-orin:~/YOLOv8-DeepSORT-Object-Tracking/ultralytics/yolo/v8/detect$ python3 predict.py model=yolov8l.pt source="test3.mp4" show=True Traceback (most recent call last): File "predict.py", line 13, in from ultralytics.yolo.engine.predictor import BasePredictor File "/home/user/YOLOv8-DeepSORT-Object-Tracking/ultralytics/init.py", line 5, in from ultralytics.hub import checks File "/home/user/YOLOv8-DeepSORT-Object-Tracking/ultralytics/hub/init.py", line 10, in from ultralytics.hub.auth import Auth File "/home/user/YOLOv8-DeepSORT-Object-Tracking/ultralytics/hub/auth.py", line 5, in from ultralytics.hub.utils import HUB_API_ROOT, request_with_credentials File "/home/user/YOLOv8-DeepSORT-Object-Tracking/ultralytics/hub/utils.py", line 10, in from ultralytics.yolo.utils import DEFAULT_CONFIG_DICT, LOGGER, RANK, SETTINGS, TryExcept, colorstr, emojis File "/home/user/YOLOv8-DeepSORT-Object-Tracking/ultralytics/yolo/utils/init.py", line 400, in SETTINGS = get_settings() File "/home/user/YOLOv8-DeepSORT-Object-Tracking/ultralytics/yolo/utils/init.py", line 371, in get_settings with torch_distributed_zero_first(RANK): File "/usr/lib/python3.8/contextlib.py", line 113, in enter return next(self.gen) File "/home/user/YOLOv8-DeepSORT-Object-Tracking/ultralytics/yolo/utils/torch_utils.py", line 34, in torch_distributed_zero_first initialized = torch.distributed.is_initialized() # prevent 'Default process group has not been initialized' errors AttributeError: module 'torch.distributed' has no attribute 'is_initialized'

[mmmstew]

In Python3:

torch.distributed.is_available() False

Is there a way to fix this?