Support Anthropic messages API

[Swicegood]

Want to run claude-3-opus, but I can't find any VSCode Plugin that currently supports it

[ppipada]

Hi,

Have some bandwidth issue since quite some time, but given that this would be a easy improvement, I will try and look into it in a few days. Thanks for your patience.

[ppipada]

@Swicegood I have pushed a update to FlexiGPT today. 1.14.0

• New release also adds support for latest openai/claude/gemini/huggingface/llama.cpp changes.

Hope this solves your requirement.

[Swicegood]

Thank you for your effort, however I'm still getting: `[ERROR] AxiosError: { "type": "error", "error": { "type": "not_found_error", "message": "Not Found" } } 404 { "date": "Wed, 20 Mar 2024 20:15:43 GMT", "content-type": "application/json", "transfer-encoding": "chunked", "connection": "close", "x-should-retry": "false", "request-id": "req_01UKsAjdMWoworvxAHfSyBMq", "x-cloud-trace-context": "aafb1ebd010e813743d008068795f4ef", "via": "1.1 google", "cf-cache-status": "DYNAMIC", "server": "cloudflare", "cf-ray": "8678603add5505df-IAD" }

Request failed with status code 404

`

[ppipada]

Can you please paste your settings: default provider, anthropicDefaultChatCompletionModel and anthropicDefaultCompletion model.

Also if possible, please also paste the FullRequest (please delete any visible secrets), this should be available in a dropdown below where you see the request. Same with response.

I myself have tested with Haiku model, but will try to reproduce with Opus based on your info.

[Swicegood]

Default provider: anthropic Default Chat Completion Model: claude-3-opus-20240229 Default Completion Model: claude-3-opus-20240229 https://api.anthropic.com { "model": "claude-3-opus-20240229", "prompt": null, "messages": [ { "role": "user", "content": "hello" } ], "temperature": 0.1, "maxTokens": 2048, "limitContextLength": 2048, "stream": false }

[ppipada]

I tried opus too from my end:

Settings:

Conversation request:

Conversation response:

Reasons for your 404 (i.e page not found) for your api request I can guess for rechecking:

• "https://api.anthropic.com" should be accessible from your location for Opus. https://www.anthropic.com/supported-countries
• Your plan in Anthropic console should have access to new models
• Some intermittent issue with api access.

One more thing to check: Do you see any errors or suspicious in output window > FlexiGPT in VSCode

[Swicegood]

Strange. It works with curl and I'm in the US so country should'nt be an issue: `curl https://api.anthropic.com/v1/messages \ --header "x-api-key: $ANTHROPIC_API_KEY" \ --header "anthropic-version: 2023-06-01" \ --header "content-type: application/json" \ --data \ '{ "model": "claude-3-opus-20240229", "max_tokens": 1024, "messages": [ {"role": "user", "content": "Hello, Claude"} ] }'

RESPONSE

{"id":"msg_01NnxrmGTfuyVUW8qe9ycU3C","type":"message","role":"assistant","content":[{"type":"text","text":"Hello! It's nice to meet you. How can I assist you today?"}],"model":"claude-3-opus-20240229","stop_reason":"end_turn","stop_sequence":null,"usage":{"input_tokens":10,"output_tokens":19}}% `

UPDATE: This from output appears to be the problem:

"url": "https://api.anthropic.com/v1/messages/v1/messages", "method": "post",

[Swicegood]

Ok I changed that (didn't realize it was set one way in user and one way in workspace) and now it's working. Thank you for your great work on this project!