triton_server_deployment

MAhaitao999 / Yolov3_Dynamic_Batch_TensorRT_Triton

将Yolov3模型转成可以进行动态Batch的TensorRT推理以及Triton Inference Serving上部署的TensorRT模型

27 stars 3 forks source link

Open Gotta-C opened 3 years ago

Gotta-C commented 3 years ago

triton的server部分有例子么

MAhaitao999 commented 3 years ago

triton的server部分有例子么

server端只需要模型和配置文件即可部署