THUDM / CodeGeeX4

CodeGeeX4-ALL-9B, a versatile model for all AI software development scenarios, including code completion, code interpreter, web search, function calling, repository-level Q&A and much more.
https://codegeex.cn
Apache License 2.0
1.29k stars 97 forks source link

is function calling supported? #8

Closed foldl closed 3 months ago

foldl commented 3 months ago

I have tested this model with same system prompt of GLM4. This model only emits parameters, but not the function name. For example, here, get_weather is not generated:

You  > what's the weather like in beijng?
A.I. > 
{"city_name": "beijing"}
ShaoboZhang commented 3 months ago

I have tested this model with same system prompt of GLM4. This model only emits parameters, but not the function name. For example, here, get_weather is not generated:

You  > what's the weather like in beijng?
A.I. > 
{"city_name": "beijing"}

Hi, we've uploaded a function calling demo, you may check it. demo

foldl commented 3 months ago

Got it. I forgot to have a check on tokenization_chatglm.py.

I managed to do a full demo here:

https://github.com/foldl/chatllm.cpp/blob/master/docs/tool_calling.md#codegeex4