feat: add OpenRouter as an option in backend for access to tons of AI models

tyllenb commented 6 months ago

Hey ya'll!

Super awesome project you have built! 🎉 I've been playing around with it a bunch and think it would be cool to add OpenRouter so that it's easy to play around with different models (Open & Closed Source). Would be great to have it if possible!

Feature Add

Add OpenRouter as an option for users to use so that they can use Open Source Models really easily with retell!
Included how to use OpenRouter in the docs

Let me know if anything else is needed to get this included, if it makes sense!

AustinZzx commented 5 months ago

Hey tyllenb, definitely like this integration of openrouter. One thing I noticed: the only diff between an openrouter implementation and OpenAI implementation is the baseUrl and API key. Will it make more sense to

Create a selection in the .env
select different endpoint / apikey in the openai file based on the LLM provider selected

Let me know what you think.

AustinZzx commented 5 months ago

Given some more thoughts, might make sense to keep two files just so that people can easily switch between them. Merging this PR. Thanks for contributing.

RetellAI / retell-custom-llm-node-demo

feat: add OpenRouter as an option in backend for access to tons of AI models #1