search

Doriandarko / omni-engineer

808 stars 128 forks source link

Feature: Replace OpenRouter with LiteLLM #3

Open MehrCurry opened 2 months ago

MehrCurry commented 2 months ago

Hi, thanks for your good work. I want to try Omni Engineer, but I am to lazy to create an OpenRouter account. So I thought LiteLLM might be a good alternative.

So I forked Omni Engineer and let Aider (shame on me) replace the OpenRouter stuff with LiteLLM. Let me know it you are interested in a PR. (https://github.com/MehrCurry/omni-engineer) Currently, it's a very rough PoC, but it works for me.

trauco-x commented 2 months ago

You rock!

ubranch commented 2 months ago

I support the idea

Doriandarko commented 2 months ago

Oh great! What is the difference here? And why preferring one over the other?

ClemLeBoy commented 2 months ago

in LiteLLM you basicially keep your own API key from your preferred LLM-provider eg. openAI and you do not have to create a seperate account with OpenRouter. LiteLLM 'simply' maps the different API-calls from different LLMs to the same openAI standard.

ghost commented 1 month ago

Hey, I'm a noob here. Can we use Groq to do this, just because it's free?

daun-io commented 1 month ago

Hi, dev from OpenRouter here! Why not have both? these are different tools with different feature sets (OpenRouter also supports custom keys, though currently in beta)

AndySharez commented 1 month ago

Hey guys,

so if I use the fork for lite llm, I do not need to install all the lite llm stuff beforehand ( https://github.com/BerriAI/litellm ) ?

I can simply install omni-engineer (lite llm version), and that is it?

@MehrCurry

Though, as I understand, openrouters advantage is that you can use different LLMs with one api key, is that correct?

Thanks for clarification