search

continuedev / continue

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains
https://docs.continue.dev/
Apache License 2.0
15.86k stars 1.21k forks source link

DeepSeek v2 API FIM Completion Support #1895

Closed razorback16 closed 1 month ago

razorback16 commented 1 month ago

Validations

Problem

DeepseekCoder has launched a new FIM completion API. You can find the DeepSeek v2 FIM API Documentation here.

I tested the API with the legacy OpenAI completions but noticed that it doesn't utilize the suffix parameter for completions as expected. Instead, it employs FIM tokens, which aren't necessary for this API. Additionally, I occasionally observed incorrect completions during my testing.

DeepSeek Coder v2 is incredibly effective, and the API is quite affordable. Integrating support for the DeepSeek API in ContinueDev could be a significant enhancement and a potential game-changer.

Solution

No response

fry69 commented 1 month ago

FIM support for DeepSeek Coder V2 is already available in Pre-Release versions, see -> https://github.com/continuedev/continue/pull/1863