-
/kind bug
cannot import tritonclient.grpc and kserve >=0.10.0 simultaneously
**What steps did you take and what happened:**
[A clear and concise description of what the bug is.]
`pip install kserv…
-
This is how the code tree looks like right now:
```
├── api
│ ├── core
│ │ └── v1alpha1
│ │ ├── groupversion_info.go
│ │ ├── model_types.go
│ │ ├── types.go
│ │…
-
**Describe the bug**
When I create 1 custom serving runtime (SR1) and 1 inference service (IS1) that is to loaded onto SR1, I observe the expected behaviour whereby IS1 will have the failure messag…
xvnyv updated
6 months ago
-
@krrishdholakia This seems to be used even when newer models like gpt-4o-mini are used with the new Azure OpenAI 2024-08-01-preview API.
_Originally posted by @Manouchehri in https://…
-
I've built various models using Olive with Whisper from examples, however despite seeing lots of references in the code within `user_Script.py` and friends to `dynamic_axes` and `batch_size`, the resu…
-
Replicate results from: https://github.com/socialfoundations/surveying-language-models
-
Here's an overview of the features we intend to work on in the near future, across Core Keras, KerasNLP, and KerasCV.
## Core Keras
### Saving & export
- [Open for Contributions] Add utility …
-
### Motivation.
As a continuation to #5367 - as this merge request was rejected and I have to maintain my own fork to support this scenario, I suggest we should add support in vLLM for model architec…
-
[train and deploy with Feast notebook fails (Part 3)](https://github.com/Azure/feast-azure/blob/main/provider/tutorial/notebooks/part3-train-and-deploy-with-feast.ipynb). When the following block is e…
-
Hello!
First of all, thank you for your constructive work on video action detection. Now, based on my own data, I've trained an adaTAD model with your framework, but I can't deploy it. I want to depl…