Instruction on using Bing API on LiteLLM to function as OpenAI compatible API

transitive-bullshit / bing-chat

Node.js client for Bing's new AI-powered search. It's like ChatGPT on steroids 🔥

MIT License

1.22k stars 128 forks source link

Instruction on using Bing API on LiteLLM to function as OpenAI compatible API #62

Open cracksauce opened 11 months ago

cracksauce commented 11 months ago

Hi there- is anyone willing to share whether you can get the bing AI API set up to use it as an OpenAI compatible API?

May be able to use LiteLLM but I'm having trouble figuring it out. They just released a server to host the liteLLM API so could be used (I think) either locally or online via proxy server?

Would be grateful if someone could explain or provide a brief tutorial since I'm struggling to figure it out... Thank you!

ishaan-jaff commented 11 months ago

Hi @cracksauce I'm the maintainer of LiteLLM - happy to help with this

why use the Bing API ?

cracksauce commented 11 months ago

@ishaan-jaff Thanks for the reply!

In short, the ability to use GPT4-capable LLM for costly products using the OpenAI API (particularly autonomous agents that use a ton of API calls). It'd be amazing to use Bing's GPT4 model since it's free with a Microsoft account.

Particularly interested in testing newer agent products like MemGPT+AutoGen and XAgent for long, complex tasks. Would probably need to code for a wrapper than transform the API endpoints into chat/completions etc. Thoughts?