developmentseed / segment-anything-services

Running segment-anything image embedding, prompting, and mask generation as torchserve services
Apache License 2.0
92 stars 10 forks source link

speed up image encoder segment-anything-fast #37

Open rbavery opened 10 months ago

rbavery commented 10 months ago

tracing a model can speed it up substantially and enable further optimization with tensorrt

examples of making the sam model trace-able: https://github.com/developmentseed/segment-anything-services/pull/25 https://github.com/facebookresearch/segment-anything/pull/326

and an example converting a Yolov5 model to tensorrt format and serving it with torchserve: https://github.com/rbavery/animal_detector/tree/master/mdv5app

rbavery commented 10 months ago

instead we can use https://github.com/pytorch-labs/segment-anything-fast/tree/main/segment_anything_fast

todo