search

UKPLab / sentence-transformers

State-of-the-Art Text Embeddings
https://www.sbert.net
Apache License 2.0
15.46k stars 2.5k forks source link

How to deploy SentenceTransformers using torchserve? #586

Open BryanWBear opened 4 years ago

BryanWBear commented 4 years ago

The closest example that I could find is https://github.com/pytorch/serve/tree/issue_390/examples/semantic_search. However, this seems a bit ad-hoc and also the model files seem to be different now. Is there a recommended way to deploy SentenceTransformers using torchserve / an example?

nreimers commented 4 years ago

Hi @BryanWBear I sadly never used torchserve, so I sadly cannot help.

BryanWBear commented 4 years ago

ah it's okay! thank you for the timely response.

lessenko commented 3 years ago

Hi @BryanWBear,

I used decision by Hamid Shojanazeri on https://github.com/pytorch/serve/issues/681.

Regards

BryanWBear commented 3 years ago

@lessenko I ended up doing the same thing. Thanks!

mattvan83 commented 3 years ago

Hi @BryanWBear and @lessenko,

From your experiences could you guide me through the main steps to deploy sentence transformer model from UPKLab on the cloud?