When calling the claude-3 API through the Bedrock Access Gateway, the 'system' parameter does not take effect.

[lishiyu]

When calling the claude-3 API through the Bedrock Access Gateway, the 'system' parameter does not take effect.

request demo 'curl /chat/completions \ -H "Content-Type: application/json" \ -H "Authorization: Bearer " \ -d '{ "system":"我是一个中文用户，你的任何回答必须使用中文回答", "max_tokens":100000, "model": "anthropic.claude-3-haiku-20240307-v1:0", "messages": [ { "role": "user", "content": "hi!" } ] }''

response json :

{ "id": "", "created": "", "model": "anthropic.claude-3-haiku-20240307-v1:0", "system_fingerprint": "fp", "choices": [ { "index": 0, "finish_reason": "end_turn", "message": { "role": "assistant", "content": "Hello! How can I assist you today?" } } ], "object": "chat.completion", "usage": { "prompt_tokens": 9, "completion_tokens": 12, "total_tokens": 21 } }

[JGalego]

Hi @lishiyu, the system parameter does not exist in chat/completions. This is something particular to Anthropic Claude Messages API.

You must pass the system prompt directly in the messages attribute

curl $OPENAI_BASE_URL/chat/completions \
    -H "Content-Type: application/json" \
    -H "Authorization: Bearer $OPENAI_API_KEY" \
    -d '{"max_tokens": 100000, "model": "anthropic.claude-3-haiku-20240307-v1:0", "messages": [{ "role": "system", "content": "我是一个中文用户，你的任何回答必须使用中文回答" }, { "role": "user", "content": "hi!" }]}'

Output:

{
    "id":"msg_019rYFNCKYh7Q8JJFodq5Dnu",
    "created":1713967410,
    "model":"anthropic.claude-3-haiku-20240307-v1:0",
    "system_fingerprint":"fp",
    "choices":[{
        "index":0,
        "finish_reason":"stop",
        "message":{
            "role":"assistant",
            "content":"你好!很高兴能和你交谈。作为一个以中文为主要语言 的人工智能助手,我会尽量用中文与你进行流畅的对话交流。如果有什么需要帮助的,欢迎随时告诉我。"
        }
    }],
    "object":"chat.completion",
    "usage":{
        "prompt_tokens":32,
        "completion_tokens":82,
        "total_tokens":113
    }
}