kubernetes-sigs wg-serving issues

kubernetes-sigs / wg-serving

WG Serving

https://github.com/kubernetes/community/tree/master/wg-serving

Apache License 2.0

13 stars 12 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

[Serving Catalog] Update vllm base deployment label

#25 jjk-g closed 3 weeks ago
2
Configure prometheus_port for both jetstream jax and pytorch servers

#24 JeffLuoo closed 4 weeks ago
3
Add readiness probe to vLLM base

#23 Bslabe123 closed 4 weeks ago
2
Add Jason (jjk-g) to Serving Catalog approvers

#22 terrytangyuan closed 1 month ago
2
[Serving Catalog] Add llama3-70b support for vllm

#21 jjk-g closed 3 weeks ago
4
Update vllm entrypoint to be metrics compatible

#20 jjk-g closed 1 month ago
2
Name the container port `metrics` in vllm

#19 JeffLuoo closed 1 month ago
7
[Serving Catalog] vLLM entrypoint doesn't have metrics endpoint

#18 jjk-g closed 1 month ago
0
List out the machine types with accelerators as part of the Catalog

#17 kerthcet opened 1 month ago
2
Fix `ai.gke.io/inference-server` label

#16 Bslabe123 closed 1 month ago
3
add HorizontalPodAutoscaler stub to catalog

#15 nojnhuh closed 2 weeks ago
12
[Serving Catalog] Add HPA configurations

#14 raywainman opened 1 month ago
2
[Serving Catalog] Add llama3-8b on jetstream-pytorch

#13 jjk-g closed 2 months ago
2
Proposing LLM Instance Gateway

#12 kfswain closed 2 months ago
5
[Serving Catalog] Add llama3.1-405b vLLM GKE support with LWS

#11 Edwinhr716 opened 2 months ago
2
kserve - initial additions, serving runtimes

#10 spolti opened 2 months ago
4
[Serving Catalog] Add TGI model server support

#9 jjk-g opened 2 months ago
0
[Serving Catalog] Add Tensorrt model server support

#8 jjk-g opened 2 months ago
0
Initialize KServe folder in serving-catalog

#7 terrytangyuan closed 2 months ago
2
Update README

#6 jjk-g closed 2 months ago
10
Add llama3-8b vLLM support

#5 jjk-g closed 2 months ago
5
[Serving Catalog] Add vLLM llama-8b support

#4 jjk-g closed 2 months ago
1
Initial readme

#3 jjk-g closed 3 months ago
6
Initial kustomized blueprints commit

#2 jjk-g closed 2 months ago
8
Update README.md

#1 terrytangyuan closed 3 months ago
2