search

uezo / aiproxy

🦉AIProxy is a reverse proxy for ChatGPT API that provides monitoring, logging, and filtering requests and responses.
Apache License 2.0
38 stars 1 forks source link

Add proxy for ✨Gemini (Experimental) #27

Closed uezo closed 3 months ago

uezo commented 3 months ago

Instantiate GeminiProxy and add route to FastAPI app.

from gemini import GeminiProxy
gemini_proxy = GeminiProxy(
    api_key="YOUR_API_KEY",
    access_logger_queue=worker.queue_client
)
gemini_proxy.add_route(app, "/gemini/v1beta/models/{model}:{method}")

This is a proxy for Google AI Studio, not for Vertex AI.

Official client from Google is not supported because it uses gPRC internally but this proxy handles ordinary HTTP access for RESTful API.