search

envoyproxy / ai-gateway

Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.
Apache License 2.0
30 stars 4 forks source link

Showcases the PoC implementation from Bloomberg and Tetrate #4

Open mathetake opened 2 weeks ago

mathetake commented 2 weeks ago

This is not intended to land the main branch but to showcase what the PoC implementation Bloomberg and Tetrate folks worked on looks like!

missBerg commented 1 week ago

Video demonstrating some of the features: https://share.descript.com/view/Xp87gpK3PGy