-
It took me some time to find this one !
https://github.com/facebookresearch/dynabench/blob/dc1e435a2a01cb2cd15bbeccfad09897db2738b8/api/migrations/20210810_01_iApXr-general_task_creation_consolidat…
-
### 🐛 Describe the bug
I've configured log4j to log using `JsonTemplateLayout`. Below the part of the [original `log4j.xml`](https://github.com/pytorch/serve/blob/master/frontend/server/src/main/reso…
-
**What would you like to be added**:
Right now, llmaz is mostly designed for large language models, however, some users may need to support traditional models as a singleton solution, let's wai…
-
I am trying to deploy a transformer by following this tutorial: https://github.com/kserve/kserve/tree/release-0.7/docs/samples/v1beta1/transformer/torchserve_image_transformer
instead of using publ…
-
保持本地调试环境与线上一致，基于 torchserve 发现了一处不一致的地方，首先看配置：
```yaml
customContainerConfig:
image: registry.cn-hangzhou.aliyuncs.com/yhr-work/torchserve
command: '["torchserve"]'
args: '["--start","--ncs…
-
### 🐛 Describe the bug
1. when to use ArgumentParser in custom handler from Basehandler, raise an error "model_service_worker.py: error: unrecognized arguments: --sock-type unix --sock-name /tmp/.ts.…
-
### 🚀 The feature
## Author: Li Ning
## Background
A stateful model possesses the ability to detect interdependencies between successive inference requests. This type of model maintains a persist…
-
你好, 感谢您分享的pytorch版ppocr模型.
想说能否提供torchserve的部署方案和文档呢?
-
### 🚀 Descirbe the improvement or the new tutorial
Create a tutorial on how to use TorchServe on AWS SageMaker
### Existing tutorials on this topic
_No response_
### Additional context
_No respon…
-
### 🐛 Describe the bug
This case is not working ：https://kserve.github.io/website/0.11/modelserving/v1beta1/torchserve/#deploy-pytorch-model-with-v2-rest-protocol.
The isvc object is ready when usin…