Open michaelfeil opened 5 months ago
@jamescalam please add the support of the Infinity Embeddings.
hi @therahulparmar and @michaelfeil — we're able to accept PRs for the infinity encoder, the library itself should be added as an optional dependency (can see huggingface, voyage, etc encoders as examples here)
@jamescalam Does call support async calls?
@michaelfeil not right now, we can add support though - is it required for infinity?
Yeah, the batching happens with multiple async request at once. This is also used when the batch size is larger than what can fit at once.
if there is no async loop running, this is challenging to control from inside of infinity.
Running a community project under https://github.com/michaelfeil/infinity - this should help with encoding.
Motivation:
Questions:
__call__
support async calls?