roboflow / inference

A fast, easy-to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.

https://inference.roboflow.com

Other

1.3k stars 116 forks source link

Add florence 2 #560

Closed MadeWithStone closed 2 weeks ago

MadeWithStone commented 2 months ago

Description

This PR adds support for florence2 in workflows. It allows for a wide variety of computer vision tasks with prompts and finetuned loras. The node returns both raw outputs from the model, and parsed supervision detections.

Type of change

Please delete options that are not relevant.

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[x] This change requires a documentation update

How has this change been tested, please provide a testcase or example of how you tested the change?

hosting the inference server on a gpu virtual machine (gcp ce) and connecting to the server using roboflow.com as the client

CLAassistant commented 2 months ago

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
1 out of 2 committers have signed the CLA.

:white_check_mark: MadeWithStone
:x: roboflowmaxwell
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

PawelPeczek-Roboflow commented 1 month ago

Hi there, we need to push that forward, I need orientation to make some decisions:

@MadeWithStone - are you willing to continue the task
@probicheaux - what is the status of Florence 2 model on the platform, in particular:
- what kind of pre-trained models we support
- where Florence 2 could run - my brief analysis indicated that only on GPU server builds - if so, the block itself is not practically useful, even potentially harmful once random users got hyped, enter Workflows and see something is broken, without proper info on how to run
- do we have plan on making good docs about this VLM?
- do we have plan to onboard the model on the inference platform? what about CPU builds?

PawelPeczek-Roboflow commented 2 weeks ago

shall we close in favour of https://github.com/roboflow/inference/pull/661