-
Is there a plan to support the Tensor Parallel and Context Parallel? I think this would make the project more flexible and attract more users.
-
### 问题确认 Search before asking
- [X] 我已经查询[历史issue](https://github.com/PaddlePaddle/PaddleDetection/issues)，没有发现相似的bug。I have searched the [issues](https://github.com/PaddlePaddle/PaddleDetection/is…
-
Description:
I converted the decoder of a TTS model (with HiFi-GAN vocoder) from PyTorch to ONNX and then to an engine format. During inference, both input and output shapes are dynamic, changing wit…
-
Here is an TensorRT inference on video example which includes detection and tracking: [https://github.com/linghu8812/yolov5_fastreid_deepsort_tensorrt](https://github.com/linghu8812/yolov5_fastreid_de…
-
Hello everyone,
Following the Diffusion Models Quanization with Model Optimizer, after this command:
`python quantize.py --model sdxl-turbo --format int8 --batch-size 2 --calib-size 32 --collect-met…
-
## To Reproduce
```py
import os
import torch
import torch_tensorrt
os.environ["CI_BUILD"] = "1"
class MyModule(torch.nn.Module):
def __init__(self):
super().__init__()
…
-
could you please give some examples about how to use tensorrt module to inference(contain the param "tile")?
-
Thanks you for your wonderful work with YOLOX.
I have a question to ask. I convert the model to TensorRT using ONNX format first. Everything was fine but the result I got from this engine are differe…
-
Hi! Thanks for making this tensorrt conversion, it is really fast!!
Is there a way to run the inference on image sequence instead of single frame?
Thanks!
-
Hello every one, the [repo](https://github.com/linghu8812/tensorrt_inference) which support yolov4: AlexeyAB/darknet#7002, scaled yolov4: WongKinYiu/ScaledYOLOv4#56, yolov5: ultralytics/yolov5#1597, a…