search

bentoml / BentoML

The easiest way to serve AI apps and models - Build reliable Inference APIs, LLM apps, Multi-model chains, RAG service, and much more!
https://bentoml.com
Apache License 2.0
6.96k stars 775 forks source link

feature: Allow to use HTTP other Method (GET, PUT, DELETE) to impl kserve predict protocol v2 #4590

Open KimSoungRyoul opened 5 months ago

KimSoungRyoul commented 5 months ago

Feature request

https://github.com/kserve/kserve/blob/master/docs/predict-api/v2/required_api.md


svc = bentoml.Service(...)

@svc.api(
    route="predict/${PATH_VARIABLE}",
    method="GET", # <----

)
async def predict(path_variable: str):
     ....

Motivation

No response

Other

No response

KimSoungRyoul commented 5 months ago

hi @frostming

I think that support other Method (as least GET) not only POST in BentoML is useful to extend BentoML

Can you include this issue in bentoml team's maelstrom or if you're positive about this minor feature, I can make the PR

thanks