Open utterances-bot opened 2 months ago
Hi Christian, thanks for your greate work. Could you also suggest, how to speed up the inference time? You already export the model to onnx but let us also know how to convert to TensorRT and also other ways to improve speed.
Hi @Masih-Zoharian,
Based on my personal experience and some NVIDIA forum threads, I don't believe the Keypoint R-CNN model included with torchvision is currently supported by TensorRT.
From my experience even ONNX Runtime's tools for collecting the calibration data used for quantizing the model don't seem set up to support the Keypoint R-CNN model.
I recommend trying a different keypoint detection model if you need something more efficient.
Dear Christian,
thanks for your email. Could you suggest me anyone which has free license for commercial use and are for real time?
Best regards Masih
On Thu, Sep 19, 2024 at 19:49 Christian J. Mills @.***> wrote:
Hi @Masih-Zoharian https://github.com/Masih-Zoharian,
Based on my personal experience and some NVIDIA forum threads, I don't believe the Keypoint R-CNN model included with torchvision is currently supported by TensorRT.
From my experience even ONNX Runtime's tools for collecting the calibration data used for quantizing the model don't seem set up to support the Keypoint R-CNN model.
I recommend trying a different keypoint detection model if you need something more efficient.
— Reply to this email directly, view it on GitHub https://github.com/cj-mills/christianjmills/issues/53#issuecomment-2361824791, or unsubscribe https://github.com/notifications/unsubscribe-auth/AUVY2YAWHMZQPJMRB3BERHLZXMFC7AVCNFSM6AAAAABONXHDD6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGNRRHAZDINZZGE . You are receiving this because you were mentioned.Message ID: @.***>
Christian Mills - Training Keypoint R-CNN Models with PyTorch
Learn how to train Keypoint R-CNN models on custom datasets with PyTorch.
https://christianjmills.com/posts/pytorch-train-keypoint-rcnn-tutorial/index.html