search

huggingface / text-embeddings-inference

A blazing fast inference solution for text embeddings models
https://huggingface.co/docs/text-embeddings-inference/quick_tour
Apache License 2.0
2.5k stars 157 forks source link

Support for deberta-v2 model variant #199

Open w3iw3i opened 5 months ago

w3iw3i commented 5 months ago

Feature request

When attempting to use this reranker model mxbai-rerank-large-v1 from huggingface with TEI, I got the following error message: 

Error: Could not create backend

Caused by:
    Could not start backend: Model is not supported: unknown variant `deberta-v2`, expected one of `bert`, `xlm-roberta`, `camembert`, `roberta`, `distilbert`, `nomic_bert` at line 21 column 28

Steps to reproduce

model=mixedbread-ai/mxbai-rerank-large-v1
volume=$PWD/models

docker run -p 8088:80 -v $volume:/models --pull always ghcr.io/huggingface/text-embeddings-inference:cpu-1.1.0 --model-id $model

Motivation

Support for deberta-v2 model variant would allow the usage of mxbai-rerank-large-v1 model with /rerank endpoint

Your contribution

Support for deberta-v2 model variant

sapountzis commented 4 months ago

Any updates?

vikram71198 commented 3 months ago

Yeah, it would be nice to get support for the DeBERTa architecture as well.

@OlivierDehaene is this model architecture on the roadmap? can we maybe get an idea of the models this library is planning on supporting with upcoming releases?

touhi99 commented 3 months ago
Stealthwriter commented 3 months ago

please add deberta

sufeng-niu commented 2 months ago

Are there any updates on this issue? it would be great if deberta is added