search

janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
https://jan.ai/
GNU Affero General Public License v3.0
22.51k stars 1.3k forks source link

feat: Jan adding google API #3010

Open Realmbird opened 3 months ago

Realmbird commented 3 months ago

Problem A clear and concise description of what the problem is. Ex. I'm always frustrated when [...] Jan only supports openai compatible api. So using https://github.com/zhu327/gemini-openai-proxy/tree/main will convert openai protocol to Gemni

Success Criteria A clear and concise description of what you want to happen.

Additional context Add any other context or screenshots about the feature request here.

Realmbird commented 3 months ago

I will try working on this

Realmbird commented 3 months ago

Attempting to use https://github.com/janhq/jan/blob/dev/extensions/inference-anthropic-extension/src/index.ts claude transformation to work for gemni

holtskinner commented 3 months ago

Note: you might be able to use this new feature for accessing Gemini on Vertex AI through the Open AI API

https://cloud.google.com/vertex-ai/generative-ai/docs/multimodal/call-gemini-using-openai-library

Realmbird commented 2 months ago

ok

imtuyethan commented 1 month ago

@Realmbird How is it going for you