search

predibase / lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
https://loraexchange.ai
Apache License 2.0
1.86k stars 125 forks source link

Add support for batching to embedder models #503

Closed tgaddair closed 3 weeks ago

tgaddair commented 3 weeks ago

TODO: