Allow arbitrary embedding models if metadata is present

taylorai / mlx_embedding_models

run embeddings in MLX

MIT License

62 stars 6 forks source link

Allow arbitrary embedding models if metadata is present #2

Open dhruv-anand-aintech opened 2 months ago

dhruv-anand-aintech commented 2 months ago

Hi,

I believe that the latest updates to the SentenceTransformers library enable model authors to provide pooling type and other metadata in the model file structure itself.

It would be great if this library didn't just depend on the registry, and could dynamically pick up the strategy values from huggingface for arbitrary models.

Thanks