-
I currently have 4 models and as suggested in https://github.com/aws/aws-neuron-sdk/issues/441, I've put everything in a single handler.
The `initialize` method looks like this
```python
self.mod…
-
### 🐛 Describe the bug
using master branch to build the image, the following is the build command.
**_./build_image.sh -g -cv cu111 -t torchserve:c11.1-u20.04-prd -bt production -ub ubuntu20.04_…
-
`pip list` in `pytorch/torchserve:0.5.3-gpu` return following. I found `torchserve` version is `0.6.0`.
Also `pytorch/torchserve:0.5.3-cpu` also have same issue
`pytorch/torchserve:0.5.3-gpu`
`…
-
please provide [DLRM](https://github.com/facebookresearch/dlrm) example.
## Is your feature request related to a problem? Please describe.
## Describe the solution
## Describe altern…
-
### 🐛 Describe the bug
Sometimes it can occur that NVML does not support monitoring queries to specific devices. Currently this leads to failing the startup phase.
### Error logs
```
2022-07-04T12…
-
### Branch
1.x branch (1.0.0rc2 or other 1.x version)
### Describe the bug
i think you forget to modify mmcv to mmengine here https://github.com/open-mmlab/mmclassification/blob/1.x/tools/deploymen…
-
## 🐛 Bug
Can't use GPU with the `local_docker` scheduler.
Module (check all that applies):
* [ ] `torchx.spec`
* [ ] `torchx.component`
* [ ] `torchx.apps`
* [ ] `torchx.runtime`
* [x…
-
Hi all,
Currently, i'm trying to send request to Torchserve by sending "image path" instead of "image data" (REST API)
Although I put the image file to Current directory of Torchserve, but in Torchs…
-
Hi there,
I am trying to run the ESG BERT model for sustainable reporting analysis created by mukut03
https://github.com/mukut03/ESG-BERT
Unfortunately, I receive the following error, which I b…
-
HI, I'm trying to use torchserve as a backend with a custom hardware setup. How do you suggest to run such that the hardware is maximally utilized? For example I tried using the benchmarks-ab.py scrip…