search

envoyproxy / ai-gateway

Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.
Apache License 2.0
30 stars 4 forks source link

Polish up POC Implementation for v0.1.0 #14

Open missBerg opened 6 days ago

missBerg commented 6 days ago

Depends on #13

@mathetake - please add more information here

mathetake commented 1 day ago

so the plan is to merge gradually while polishing it. Even though I want to wait for the design doc #16, I will start adding the impl as soon as possible once the repo setup (like container publish etc) since the design won't change that much at this point and it will serve more of an informational purpose for anyone coming in here for the first time. It will start with the API definition PR (#13) as discussed, but little by little - not with the giant single PR.

missBerg commented 1 day ago

Sounds good @mathetake