Does qwen2.5-coder support function calling?

[Muuut]

According to the documentation, I use VLLM to build a openai compatible server for qwen2.5-coder-7b-instruct.

That is my code

messages = [
    {
        "role": "user",
        "content": "Calculate how many r's are in the word 'strawberry'"
    }
]

# Define the tools
tools = [{
    "type": "function",
    "function": {
        "name": "execute_python",
        "description": "Execute python code in a Jupyter notebook cell and return result",
        "parameters": {
            "type": "object",
            "properties": {
                "code": {
                    "type": "string",
                    "description": "The python code to execute in a single cell"
                }
            },
            "required": ["code"]
        }
    }
}]

# Generate text with OpenAI
response = client.chat.completions.create(
    model="qwen2.5-7B-coder",
    messages=messages,
    tools=tools,
)

However, I got this: The finish_reason is "stop" instead of "tool_calls", and the tool_calls is empty. So I wonder whether qwen2.5-coder series support function calling?

[sagarey]

same problem recurred on Qwen2.5-Coder-32B-instruct deployed by vllm, while Qwen2.5-32B-instruct support function calling as expected.

[Muuut]

same problem recurred on Qwen2.5-Coder-32B-instruct deployed by vllm, while Qwen2.5-32B-instruct support function calling as expected.

I did not set the system content in the message before. After setting, function calling works normally.

[sagarey]

same problem recurred on Qwen2.5-Coder-32B-instruct deployed by vllm, while Qwen2.5-32B-instruct support function calling as expected.

I did not set the system content in the message before. After setting, function calling works normally.

Default qwen system prompt? I tried it, and still the problem that tool_calls is empty and content returns tool call string. Whether it is Qwen2.5-Coder-32B-instruct or Qwen2.5-Coder-7B-instruct, without any adjustments, only model switch to Qwen2.5-32B-instruct or Qwen2.5-7B-instruct can tool_calls be obtained correctly.