Support a custom chat model

EinStack / glide

🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps

https://docs.einstack.ai/glide/

Apache License 2.0

129 stars 20 forks source link

Support a custom chat model #121

Open roma-glushko opened 9 months ago

roma-glushko commented 9 months ago

To make Glide more flexible, we may define an API that external model/provider should support, so users can make an adapter to plug in models Glide has not yet supported or proprietary-hosted models.

roma-glushko commented 9 months ago

cc @mkrueger12