-
### 🐛 Describe the bug
## Disclaimer
- Running Torchserve + ONNX + CPU is fine.
- I am aware that there is an open issue regarding a similar situation below, but I am confronting something more.
…
-
### 🐛 Describe the bug
I am trying to surve ASR whisper model in torchserve but i am facing worker issue
### Error logs
main org.pytorch.serve.servingsdk.impl.PluginsManager - Loading snapshot ser…
-
### 🚀 The feature
TorchText release is being deprecated by PyTorch starting PyTorch 2.4 https://github.com/pytorch/text/issues/2250
TorchServe will follow the same. The release of TorchServe wit…
-
### 📚 The doc issue
It looks like Release 0.11.1 added a token authorization system defaulted to on. I think it could be useful to give some suggestions for how users might use this system in real-wo…
-
### 🚀 The feature
According to [PyTorch installation instruction](https://pytorch.org/), Torchserve needs to update PyTorch installation and docker for Mac M1.
"MacOS Conda binaries are for x86_…
-
Hi, I've been running models with Torchserve 0.11.0 on Sagemaker and noticed following warning:
`WARNING: sun.reflect.Reflection.getCallerClass is not supported. This will impact performance.` when s…
-
### 📚 The doc issue
https://pytorch.org/serve/
This link needs updating with new features, examples
### Suggest a potential alternative/fix
_No response_
-
### 🚀 The feature
Release py3.10 binaries for torchserve and model-archiver
### Motivation, pitch
There's a strong customer demand for py3.10 [DLAMI](https://docs.aws.amazon.com/dlami/latest/devgui…
-
### 🐛 Describe the bug
Torchserve supports batching of multiple requests and batch_size value is provided while registering the model.
Request Envelope receives the input as list of multiple reque…
-
Authors : [Hamid Shojanazeri](https://github.com/HamidShojanazeri), [Shen Li](https://github.com/mrshenli)
## **Problem statement**
Currently, Torchserve does not have a general solution for s…