-
Hi, I ran this [script](https://github.com/tensorflow/tensorrt/blob/master/tftrt/benchmarking-python/huggingface/bert/models/bert_base_cased/run_inference.sh). The model was able to convert to tensorr…
-
## Description
Casting an UINT8 to FLOAT16/32 after a `transpose` operation breaks the graph (`network.num_outputs = 0`).
Casting before the transpose works fine.
## Environment
**Tens…
-
Hello,
I'm using 'nvcr.io/nvidia/tensorflow:22.07-tf2-py3' container.
When I try to build TF-TRT example, I get error message
```
root@196ef112f21c:/workspace/tensorrt/tftrt/examples-cpp/mnist_d…
-
Hi,
I have a quite large model (140MB weights) that, that was successfully converted to TRT with TF 2.1.0
But with 2.2.0 rc1,rc2,rc3 it always fails with following message
`
Engine creation f…
-
-
I want to test, but could not find where to download the models in project?
-
Traceback (most recent call last):
File "jetson_stream.py", line 9, in
from object_detector_trt import ObjectDetectorTRT
File "/home/nano/sc2.2/scripts/mobile_detector/object_detector_trt.…
-
Hi naisy i tried to use the tensorRT implementation of your code on my jetson tx2.
(in config.yml model_type: 'trt_v1')
but i get the following error:
File "run_image.py", line 131, in main
…
-
Quick remark (I'm not sure if this is pertinent, as I don't know if WhisperX uses Tensorflow in any meaningful way?):
I get the below warning while running WhisperX in Google Colab:
> `W tensorf…
-
I tried to run model Bert on Jetson, Ampere GPU for evaluating PTQ (post-training quantization) Int8 accuracy using SQuAD dataset , but it fails with the error below during building the engine:
WA…