search

kubernetes-sigs / wg-serving

WG Serving
https://github.com/kubernetes/community/tree/master/wg-serving
Apache License 2.0
13 stars 12 forks source link

Add llama3-8b vLLM support #5

Closed jjk-g closed 2 months ago

jjk-g commented 2 months ago

Fixes https://github.com/kubernetes-sigs/wg-serving/issues/4

ahg-g commented 2 months ago

/lgtm /approve /hold

k8s-ci-robot commented 2 months ago

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: ahg-g, jjk-g

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files: - ~~[serving-catalog/OWNERS](https://github.com/kubernetes-sigs/wg-serving/blob/main/serving-catalog/OWNERS)~~ [ahg-g] Approvers can indicate their approval by writing `/approve` in a comment Approvers can cancel approval by writing `/approve cancel` in a comment
ahg-g commented 2 months ago

/lgtm

/label tide/merge-method-squash

jjk-g commented 2 months ago

@ahg-g Is this still meant to be on hold?

ahg-g commented 2 months ago

no

/hold cancel