michaelfeil / infinity

Infinity is a high-throughput, low-latency REST API for serving vector embeddings, supporting a wide range of text-embedding models and frameworks.
https://michaelfeil.eu/infinity/
MIT License
959 stars 71 forks source link

[Benchmark] - clip embeddings #259

Open michaelfeil opened 3 weeks ago

michaelfeil commented 3 weeks ago

Feature request

Benchmark Clip embedding performance

Motivation

E.g. benchmark script.

Might depend on #258 first, otherwise we would just measure download speed imo.

Your contribution

Looking for contributors!