EmbeddingsService implementations for Huggingface

datastax / pulsar-transformations

Apache License 2.0

10 stars 8 forks source link

EmbeddingsService implementations for Huggingface #84

Closed dlg99 closed 1 year ago

dlg99 commented 1 year ago

EmbeddingsService implementations for Huggingface

using rest api
using local (file://.. uri) model

The model requested there should be trained for "sentence similarity" task

eolivelli commented 1 year ago

Regarding the fact that we use HG only for embeddings and that the HG configuration should be at the top level like "openai", I think that we could support the "Inference API" at some point in the future. https://huggingface.co/docs/api-inference/detailed_parameters

Having it at the top level also makes the configuration easier for the users