neo-ai / neo-ai-dlr

Neo-AI-DLR is a common runtime for machine learning models compiled by AWS SageMaker Neo, TVM, or TreeLite.
Apache License 2.0
492 stars 106 forks source link

DLR Building on Jetson Device Throws unhandled errors #409

Open mycpuorg opened 2 years ago

mycpuorg commented 2 years ago

DLR Build Machine (and target machine both) is NVidia Jetson Xavier AGX. Ubuntu 18.04 JetPack4.6

Software Info:

xavier:~$ jetson_release 
 - NVIDIA Jetson AGX Xavier [16GB]
   * Jetpack 4.6 [L4T 32.6.1]
   * NV Power Mode: MODE_15W_DESKTOP - Type: 7
   * jetson_stats.service: active
 - Libraries:
   * CUDA: 10.2.300
   * cuDNN: 8.2.1.32
   * TensorRT: 8.0.1.6
   * Visionworks: 1.6.0.501
   * OpenCV: 4.1.1 compiled CUDA: NO
   * VPI: ii libnvvpi1 1.1.15 arm64 NVIDIA Vision Programming Interface library
   * Vulkan: 1.2.70

Steps

apivovarov commented 2 years ago

The issue was fixed in TVM in this PR https://github.com/apache/tvm/pull/8607/files

Workaround: edit 3rdparty/tvm/src/runtime/contrib/tensorrt/tensorrt_logger.h and add noexcept to log method on Line 42

  void log(Severity severity, const char* msg) noexcept override {
mycpuorg commented 2 years ago

@apivovarov Thanks!