search

squaredtechnologies / thread

AI-powered Jupyter Notebook — use local AI to generate and edit code cells, automatically fix errors, and chat with your data
https://www.thread.dev
GNU Affero General Public License v3.0
974 stars 49 forks source link

support local OpenAI-like server #7

Closed namin closed 2 weeks ago

vercel[bot] commented 2 weeks ago

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
thread ❌ Failed (Inspect) Jun 11, 2024 7:00pm
alishobeiri commented 2 weeks ago

Hi Nada,

Thank you so much for the pull request, if it's okay with you I have some UI changes that I will integrate with yours so a user can set the URL in the UI as well.

Will add those shortly and approve. Thank you again for opening up the PR!

namin commented 2 weeks ago

Sounds great, thank you!

rambalachandran commented 2 weeks ago

One recommendation is to add and test support for openrouter, which provides openai equivalent api but can provide access yo a wide range of models including claude, llama among others

https://openrouter.ai/

alishobeiri commented 2 weeks ago

Just realized it is easier to do this if I merge cause otherwise I need to submit a PR to your fork to be able to have it submitted here :)