roboflow / inference

A fast, easy-to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.
https://inference.roboflow.com
Other
1.3k stars 116 forks source link

Add transformers extras #575

Closed probicheaux closed 1 month ago

probicheaux commented 1 month ago

Description

Adds new extras install which install pytorch and other necessary dependencies for florence2, paligemma, and other transformers packages

Type of change

Please delete options that are not relevant.

How has this change been tested, please provide a testcase or example of how you tested the change?

Locally

Any specific deployment considerations

New extras wheel to be built

Docs

probicheaux commented 1 month ago

Addressing @PawelPeczek-Roboflow 's comments from https://github.com/roboflow/inference/pull/540

not sure how or why to document this package in particular

probicheaux commented 1 month ago

Could you please add the transformers extras to https://github.com/roboflow/inference/blob/e601ad7898e35477ee872c8e92388d5b2a56b47b/docs/models.md#L91-L90

Added to extras table with warning about flash_attn

I forgot how much a pain that package is, we can't even install it in a fresh env becasue it needs packaging to install. If we want to make sure that stuff is getting installed correctly, we should probably start work on an install script for inference

PawelPeczek-Roboflow commented 1 month ago

@probicheaux this PR was reverted due to failing CI