-
# TorchServe Model Analyzer
## Tasks
Milestone 1
* [x] #1442
* [x] #1573
* [x] #1484
* [x] #1259
* [x] #1540
Milestone 2
* [x] #1506
* [x] #1504
* [ ] AutoML for inference
## Pr…
-
I am asking again because the Issue(#1777 ) is not reopen.
I have created a custom handler based on the documentation.
However, it is not working well.
Below is the procedure I have followed.
I …
-
Hello,
I have a multi-tenant application and I would like to control who have access to each endpoint with API Keys. That is still a bit unclear for me. How can I authorize users before they consum…
-
**Steps to reproduce:**
run code sample from https://huggingface.co/Intel/distilbart-cnn-12-6-int8-dynamic
```
from optimum.intel.neural_compressor.quantization import IncQuantizedModelForSeq2SeqLM…
-
### Bug description
I'm trying to train on multi-GPU from Jupyter. I do according to this https://pytorch-lightning.readthedocs.io/en/stable/accelerators/gpu_intermediate.html#distributed-data-parall…
-
### 🚀 The feature
Hey folks - I was wondering whether TorchServe has considered supporting the Inference V2 API proposed by KServe (https://github.com/kserve/kserve/blob/master/docs/predict-api/v2/re…
-
I was using torchserve to production service, I was able to return the predictions with a JSON string, but I was unable to get the response with a JSON header.
-
## 🐛 Bug
**Describe the bug** `Can't pickle local object 'to_map_style_dataset.._MapStyleDataset'` error is produced while saving the entire model with `torch.save(model, "model.pth")`
**To Rep…
-
/kind bug
**What steps did you take and what happened:**
This is in reference with this issue. [https://github.com/kserve/kserve/issues/2370](https://github.com/kserve/kserve/issues/2370) We intro…
-
How to fix error: unable to recognize "STDIN": no matches for kind "Profile" in version "kubeflow.org/v1beta1
```
(base) [root@kubuflow manifests]# kustomize build common/user-namespace/base | ku…