-
First, I created docker container by followed https://github.com/pytorch/serve/tree/master/docker#create-torchserve-docker-image, I leaves all configs default except remove `--rm` in `docker run ...` …
-
**What steps did you take and what happened:**
- Visit the documentation link at: https://kserve.github.io/website/0.9/modelserving/inference_api/
- Notice that routes explaining `/v2` endpoints suc…
-
I need to pass several types of metadata for each of my requests. @adriangonz as per our [community slack conversation](https://seldondev.slack.com/archives/C03DQFTFXMX/p1671494800794449) the `types.p…
-
**Context**: For inference (map creation) a TorchScript model is packaged into a TorchServe docker container which is then deployed into Google Cloud Run to allow parallel predictions for each pixel o…
-
**Describe the bug**
Because torchserve uses torch.profiler since version 0.2.0, the current docker/serve/Dockerfile throws an error.
See https://github.com/pytorch/serve/issues/1548
**Bug …
-
## Context
* torchserve version: torchserve:0.4.1-gpu
* torch-model-archiver version: 0.4.2
* torch version: 1.9.0
* torchvision version [if any]: N/A
* torchtext version [if any]: N/A
* tor…
-
**Context**: A new docker image is released with every package version: https://github.com/nasaharvest/openmapflow/actions/workflows/docker.yaml
**Issue**: From version 0.1.0 to 0.1.1 the docker im…
-
/kind feature
**Describe the solution you'd like**
[A clear and concise description of what you want to happen.]
Remove hard dependency on the knative local gateway and let kfserving have the o…
-
🐛 Bug report
I'm trying to use a custom crowd counting model and while serving it gives me an error while importing custom model libraries.
Python Import code is like below:
```python3
mo…
-
Is it possible to use coref model in torchserve production environment? Is there any tutorial?