TensorRT Models Deploy from ONNX
Install Depends
see INSTALL.md
Build from Docker
docker build -t tensorrt_inference:0.1.0_rc .How to Use
-
Build tensorrt_inference project:
git clone https://github.com/linghu8812/tensorrt_inference.git cd tensorrt_inference/project mkdir build && cd build cmake .. make -jafter these steps, the executable program
tensorrt_inferenceand all support model shared libraries have been built. -
Run tensorrt_inference
./tensorrt_inferenceit will show:
Please design model arch, config file and folder name!- Inference with models, take yolov5 model as example, put
yolov5s.onnxmodel intoweightsfolder:
cd ../../bin/
./tensorrt_inference yolov5 ../configs/yolov5/config.yaml ../samples/detection_segmentationUse one model library example can reference here example
Supported Models
download transfered ONNX models, and put them into folder weights: https://pan.baidu.com/s/1Ff_SA9Q66DUnZjSipPa74Q, code: opkp
| models | framework | instruction |
|---|---|---|
| lenet | PyTorch | An example from model training to TensorRT model deploy |
| alexnet | MXNet Gluon | MXNet Gluon example |
| arcface | MXNet Symbol | MXNet Symbol and face recognition example |
| CenterFace | ONNX | rewrite ONNX model and face detection example |
| efficientnet | Keras | Keras to ONNX example |
| face_alignment | MXNet Symbol | MXNet Symbol and face key points detection example |
| fast-reid | PyTorch | PyTorch and pedestrian reid example |
| FCN | GluonCV | MXNet GluonCV semantic segmentation example |
| gender-age | MXNet Symbol | MXNet Symbol and face gender and age recognize example |
| ghostnet | PyTorch | PyTorch example |
| MiniFASNet | PyTorch | PyTorch face anti spoofing example |
| mmpose | PyTorch | PyTorch person key points detect example |
| nanodet | PyTorch | PyTorchlightweight anchor-free object detection example |
| RetinaFace | MXNet Symbol | MXNet Symbol and face detection example |
| ScaledYOLOv4 | PyTorch | YOLOv4 large with PyTorch implementation |
| scrfd | PyTorch | PyTorch scrfd face detection example |
| seresnext | PyTorch | PyTorch example |
| Swin-Transformer | timm | timm image classification example |
| yolor | PyTorch | PyTorch and object detection example |
| Yolov4 | darknet | darknet and object detection example |
| yolov5 | PyTorch | PyTorch and object detection example |
| YOLOv6 | PyTorch | PyTorch and object detection example |
| yolov7 | PyTorch | PyTorch and object detection example |
| yolov8 | ultralytics | ultralytics object detection example |
Discussion Groups
- QQ group: 588966055