roboflow / inference

A fast, easy-to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.
https://inference.roboflow.com
Other
1.15k stars 85 forks source link

Follow config to import core models #508

Closed iurisilvio closed 2 weeks ago

iurisilvio commented 2 weeks ago

Description

Do not try to import disabled models. It improve import time a lot. Trying to reduce cold start time.

I'm not considering paligemma and florence2 core models here, they're always imported (but in most cases we don't install them).

Type of change

How has this change been tested, please provide a testcase or example of how you tested the change?

CI pass