zhu327 / gemini-openai-proxy

A proxy for converting the OpenAI API protocol to the Google Gemini Pro protocol.
MIT License
580 stars 109 forks source link

Eliminate OpenAI -> Gemini Model Mapping #38

Closed ekatiyar closed 3 months ago

ekatiyar commented 4 months ago

Addresses #35

This change eliminates the mapping of openAI models to gemini models and directly exposes the underlying gemini models to the api endpoints directly. This was motivated by my own issues with using Google's openAI API Compatible Endpoint.

My own usecase is flexible enough to use non-openAI named models with the OpenAI API, so the model mapping from openAI model names to gemini model names just serves to confuse things.

I recognize this may not be the case for all users of this project and some clients may only be able to handle OpenAI-named models; in that case feel free to reject this PR.

ekatiyar commented 4 months ago

If this is something you are interested in, I can create a separate branch without the readme changes

ekatiyar commented 3 months ago

This is just the main branch of my fork, which is kinda messy since I've added some other stuff since I opened this pr. I can reorganize it so its easier to merge into your repo, but to start with I'd think I'd want to merge in the embeddings support I added in #39 , and then create a separate branch for eliminating the model mapping

ekatiyar commented 3 months ago

Closing this PR in favor of merging in #41 which accomplishes the same thing in a cleaner and non-disruptive way