support fp16 inference for grounding_dino

IDEA-Research / Grounded-Segment-Anything

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

https://arxiv.org/abs/2401.14159

Apache License 2.0

14.12k stars 1.31k forks source link

support fp16 inference for grounding_dino #463

Closed zylo117 closed 4 months ago

zylo117 commented 4 months ago

this is 15% faster with almost no consequence

rentainhe commented 4 months ago

Thanks a lot for supporting the faster inference process!