Add support for Claude Sonnet 3.5

[dandv]

Validations

• [X] I believe this is a way to improve. I'll try to join the Continue Discord for questions
• [X] I'm not able to find an open issue that requests the same enhancement

Problem

I've added my Anthropic API key, but don't see any information in the UI about the available model versions. I could replace the model string in config.json with claude-3-5-sonnet-20240620 but would be nice to have a friendlier UI for this, otherwise users may think the best model for coding isn't supported yet.

Solution

The OpenAI configuration screen has an option to "Automatically populate the model list by calling the /models endpoint of the server". Until Anthropic adds an endpoint to list available models, they could be

• hard coded
• scraped from https://docs.anthropic.com/en/api/claude-on-vertex-ai#accessing-vertex-ai
• obtained programmatically from Amazon Bedrock

[fry69]

Sonnet-3.5 is supported in the VSCode Pre-Release extension, see https://github.com/continuedev/continue/commit/c0705b363153d096c2e68e223c4337f9f72f0951

A new stable release is soon to be released, for the time being switch to Pre-Release for the Continue extension inside VScode.

For JetBrains editors Pre-Release versions seem to be broken, you may have to wait until the next stable release happens.

[sestinj]

In the next release we'll not only have Sonnet in the model selection UI, but will be encouraging users to immediately input their Claude API key for Sonnet 3.5. For now this is becoming a strongly recommended model

[sestinj]

This is now released in the latest pre-release