search

InternLM / lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
https://lmdeploy.readthedocs.io/en/latest/
Apache License 2.0
4.73k stars 431 forks source link

Florence 2 support :) #2052

Open SinanAkkoyun opened 4 months ago

SinanAkkoyun commented 4 months ago

Motivation

Hey! I am currently struggling to get Florence 2 running in a VRAM efficient batched way. Having easy and scalable API access would be very awesome if it's not too much work!

Thank you very much ^^

Related resources

No response

Additional context

No response

zhyncs commented 4 months ago

ref https://github.com/InternLM/lmdeploy/blob/main/docs/en/advance/pytorch_new_model.md https://huggingface.co/collections/microsoft/florence-6669f44df0d87d9c3bfb76de

davertor commented 2 months ago

Is there any plan to implement florence2 into this project? @lvhan028