search

saoudrizwan / claude-dev

Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, and more with your permission every step of the way.
https://marketplace.visualstudio.com/items?itemName=saoudrizwan.claude-dev
MIT License
4.04k stars 381 forks source link

feat: support any openai compatible API (including Ollama) #162

Closed sammcj closed 1 week ago

sammcj commented 2 weeks ago

Hopefully I've brought everything across from my fork where I was testing this 😅

I’ll leave this as a draft for now as there’s bound to be some rough edges etc… but if anyone has fixes / improvements for it feel free to raise a PR against my branch and we can combine efforts.

rhizanthemum commented 2 weeks ago

This would be awesome.

but for the time being, have you tried OpenRouter?

image
zyzhang1130 commented 2 weeks ago

This would be awesome.

but for the time being, have you tried OpenRouter?

image

you cannot use OpenAI API for OpenRouter. For some of us we only have access to OpenAI API.

zyzhang1130 commented 2 weeks ago

@sammcj thank you so much for your hard work man! Due to the recent decline in 3.5 sonnet's performance I feel it is imperative to switch to OpenAI model. I've been trying to implement it myself but always faced some issues that I couldn't resolve. Your pr is perfect for my use case! Once again tysm!

LACHENNG commented 1 week ago

awesome work man!

killerapp commented 1 week ago

Looking forward to this feature!

I would caution that we should lead folks to not try just any old model, because they are going to have horrible results (IMHO) I like how the aider project has a leaderboard, I think we should test and steer people towards DeekSeek coder (likely) or something else that we know works well with Claude-Dev. Just give people a 'Your Milage May Vary' warning.

https://aider.chat/docs/leaderboards/

image

sammcj commented 1 week ago

The latest release includes support for custom openai compatible APIs 🎉