search

marqo-ai / marqo

Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai
https://www.marqo.ai/
Apache License 2.0
4.59k stars 189 forks source link

[ENHANCEMENT] support timm models for images #60

Open jn2clark opened 2 years ago

jn2clark commented 2 years ago

Is your feature request related to a problem? Please describe. At the moment, only CLIP models are supported. These are good models and work across language and text. However, there are lots of other models in timm that are SOTA in classification and can still provide good embedding. They also span a large range of sizes and architectures so offer good accuracy/latency trade-offs.

Describe the solution you'd like A new class of timm models can be specified for the "model" field at index creation time.

Describe alternatives you've considered None

Additional context https://github.com/rwightman/pytorch-image-models

jn2clark commented 2 years ago

I started a POC here for the reader https://github.com/marqo-ai/marqo/tree/timm_models_support