Open rbavery opened 10 months ago
tracing a model can speed it up substantially and enable further optimization with tensorrt
examples of making the sam model trace-able: https://github.com/developmentseed/segment-anything-services/pull/25 https://github.com/facebookresearch/segment-anything/pull/326
and an example converting a Yolov5 model to tensorrt format and serving it with torchserve: https://github.com/rbavery/animal_detector/tree/master/mdv5app
instead we can use https://github.com/pytorch-labs/segment-anything-fast/tree/main/segment_anything_fast
todo
tracing a model can speed it up substantially and enable further optimization with tensorrt
examples of making the sam model trace-able: https://github.com/developmentseed/segment-anything-services/pull/25 https://github.com/facebookresearch/segment-anything/pull/326
and an example converting a Yolov5 model to tensorrt format and serving it with torchserve: https://github.com/rbavery/animal_detector/tree/master/mdv5app