Code Completion for Azure

carlrobertoh / CodeGPT

JetBrains extension providing access to state-of-the-art LLMs, such as GPT-4, Claude 3, Code Llama, and others, all for free

https://codegpt.ee

Apache License 2.0

906 stars 186 forks source link

Code Completion for Azure #435

Open QuadStingray opened 3 months ago

QuadStingray commented 3 months ago

Describe the need of your request

Code Completion sounds fantastic, and I would love to test it. When do you plan to activate this awesome feature for Azure OpenAI or Custom OpenAI Providers?

Proposed solution

No response

Additional context

I like your Plugin and use it nearly every day

PhilKes commented 2 months ago

You should be able to use Azure for code-completions now (https://github.com/carlrobertoh/CodeGPT/pull/476) In the Custom OpenAI Providers settings:

FabGoe commented 2 months ago

Thanks for the implemention. I tried the recent Azure GPT3 and GPT4 models, which only support the "chat/completations" API (not the normal "/completations" API). I cannot get it to run. The connection test fails (see screenshot).

sisve commented 2 months ago

That is correct, you would need to create a separate deployment using the gpt-3.5-turbo-instruct model to use the /completions api. Azure seems to ignore the model provided in the request body, and instead use the one associated with your deployment.

FabGoe commented 2 months ago

@sisve Thanks for your help and fast response! I got it working now with gpt-3.5-turbo-instruct. This wasn't documented well in the Azure OpenAI manuals.