-
Is there a tool that can inspect dla standalone loadable file, i want to get inner nodes/layers info ?
I use trtexec load dla loadble file wrong as follow:
```
[09/04/2024-13:51:41] [I] Engine loa…
-
I remove the ``--buildDLAStandalone`` flag [here](https://github.com/NVIDIA-AI-IOT/cuDLA-samples/blob/main/data/model/build_dla_standalone_loadable.sh#L27) since I just have jetson Orin(no Drive Orin)…
hygxy updated
1 month ago
-
Hello,
I could run your repo and when I printed input and output tensors size, the values were
```bash
[hybrid mode] create cuDLA device SUCCESS
[hybrid mode] load cuDLA module from memory SUCCESS…
-
The code only measures inference time for htbrid mode.
Can I get the correct inference time for standalone mode by commenting the conditional statement ?
If not, how to measure the time correctly?…
-
2yjia updated
1 month ago
-
Hi all.
I'm wondering that input resolution of yolov5 is 3x672x672, but why in https://github.com/NVIDIA-AI-IOT/cuDLA-samples/blob/a2d645b61920fead0cf70c79506518b0a159463c/src/matx_reformat/matx_re…
dattv updated
1 month ago
-
In quantize.py I find the following function. And it is used in qat.py. why should we find the quantizer_pairs? why should we set:
major = bottleneck.cv1.conv._input_quantizer
…
-
## Description
I am using two threads and two CUDA streams to perform inference on two models using cuDLA and GPU TensorRT.
However, I have observed that when performing inference on one model using…
-
I've got a brand new Orin AGX developer kit (64GB) and used the SDK Manager to download and flash the latest Ubuntu (22.04) and JetPack SDK (6.1).
I'm trying to build a container (I need diffusers …
-
Hi, I'm using jetpack 5.1.2. The hybrid mode works fine, but the standalone mode returns the error below:
How may I fix this?
Besides, the performance is for hybrid mode is below:
The MAP is …