Open MoritzLaurer opened 2 weeks ago
(could maybe be useful to double check all the TEI routes (Swagger here) and related client methods to make sure that they work correctly)
Thanks for reporting these with a reproducible example @MoritzLaurer. I'm figuring out a solution to avoid this kind of problems where we don't call the correct endpoint because of difference between Inference API and Inference Endpoints (similar to https://github.com/huggingface/huggingface_hub/issues/2484). Will keep you posted.
Describe the bug
I have a TEI embedding model endpoint created like this:
Based on the docs here, I should be able to call it like this:
This results in this (hard to interpret) error message:
HfHubHTTPError: 422 Client Error: Unprocessable Entity for url: https://c5hhcabur7dqwyj7.us-east-1.aws.endpoints.huggingface.cloud/ (Request ID: nEd4Xz) Make sure 'sentence-similarity' task is supported by the model.
It does work when making the
/similarity
route from TEI explicit:Seems like the route is not set correctly by the client.
Reproduction
No response
Logs
No response
System info