search

saoudrizwan / claude-dev

Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, and more with your permission every step of the way.
https://marketplace.visualstudio.com/items?itemName=saoudrizwan.claude-dev
MIT License
4.04k stars 381 forks source link

OpenAI compatible API support #159

Closed zyzhang1130 closed 1 week ago

zyzhang1130 commented 2 weeks ago

From my own testing sonnet 3.5 now is worse than gpt-4o. Can I request to make gpt-4o available on claude dev as well?

danghieuan commented 2 weeks ago

@zyzhang1130 You can use API Provider with OpenRouter for GPT-4o.

zyzhang1130 commented 2 weeks ago

@danghieuan I only have OpenAI API key. Can you make directly querying from OpenAI an option?

danghieuan commented 2 weeks ago

@zyzhang1130 It integrated in Claude-dev. Pls check setting of extension.

zyzhang1130 commented 2 weeks ago

@zyzhang1130 It integrated in Claude-dev. Pls check setting of extension.

Only OpenRouter has option for OpenAI model (unless I missed something), and it does not accept OpenAI API.

saoudrizwan commented 2 weeks ago

OpenAI + custom base URLs are coming

juancarlosm commented 1 week ago

OpenAI + custom base URLs are coming

Great! That will support LiteLLM! So new models and local ollama will be available :)

saoudrizwan commented 1 week ago

OpenAI compatible APIs are now supported in v1.5.19, this is very much experimental especially for ollama so please try it out and let me know how it goes!

candalfigomoro commented 1 week ago

@saoudrizwan For the "sliding window context management", are you considering the fact that these models have a context length lower than 200k (eg. 128k for gpt-4o)?

saoudrizwan commented 1 week ago

@candalfigomoro I actually set sane defaults and for context window set 128k but in the future may let users input context window in settings (for now that seemed to overcomplicate things)

ctwhome commented 6 days ago

Which URL for OpenAI can we use? It looks like https://api.openai.com is not working:

image image
BartNetJS commented 6 days ago

Use https://api.openai.com/v1