CodeGeeX4-ALL-9B, a versatile model for all AI software development scenarios, including code completion, code interpreter, web search, function calling, repository-level Q&A and much more.
I'm encountering an error while using CodeGeeX4 with vllm v0.5.5. The error message states:
As of transformers v4.44, default chat template is no longer allowed, so you must provide a chat template if the tokenizer does not define one.
I noticed that you provide the apply_chat_template function, but as far as I understand, it seems that a Jinja chat_template might also be required in this case. For reference, this is the code section I was looking at: chat_utils.py#L271.
Could you please update the tokenizer to include the necessary chat template for CodeGeeX4?
Hi CodeGeeX4 team,
I'm encountering an error while using CodeGeeX4 with vllm v0.5.5. The error message states:
I noticed that you provide the
apply_chat_templatefunction, but as far as I understand, it seems that a Jinjachat_templatemight also be required in this case. For reference, this is the code section I was looking at: chat_utils.py#L271.Could you please update the tokenizer to include the necessary chat template for CodeGeeX4?
Thank you for your assistance!