search

aws-samples / llm-gateway

MIT No Attribution
24 stars 4 forks source link

OpenAI or OpenAPI? #88

Open drmindle12358 opened 1 month ago

drmindle12358 commented 1 month ago

Last sentence of the project overview: through an 'OpenAI' interface?

Project Overview This project provides sample code and CDK for deploying APIs which provide a secure and scalable interface with Amazon Bedrock.

This project allows users to deploy a Rest API that supports streaming streaming responses from Amazon Bedrock through an OpenAI interface

mirodrr2 commented 1 month ago

OpenAI. Meaning that you can use the OpenAI client and consume Bedrock Models by overriding the base url to point to your llm-gateway

drmindle12358 commented 1 month ago

Thanks for confirming it's 'OpenAI' client. Now do you mean OpenAI's Python client?

However the interface of the BaseChatModel in your repo doesn't looks like any of OpenAI's API interface, hence the confusion. Thanks for your response.