search

camenduru / grounded-segment-anything-colab

Grounding DINO with Segment Anything & Stable Diffusion colab
The Unlicense
191 stars 17 forks source link

Slow inference on Google Colab A100 GPU #5

Open alelordelo opened 1 year ago

alelordelo commented 1 year ago

Hi, thanks for this repo!

I am getting super slow inference, compared to Grounded-SAM HF demo, ex:

20 secs on T4 GPU https://huggingface.co/spaces/IDEA-Research/Grounded-SAM

200sec on A100 GPU (10x times faster than T4) https://github.com/camenduru/grounded-segment-anything-colab/

Did you also experience this?