NolanoOrg / cformers

SoTA Transformers with C-backend for fast inference on your CPU.
MIT License
311 stars 29 forks source link

run python chat.py ERROR #42

Open moon-fall opened 1 year ago

moon-fall commented 1 year ago

ggml_compute_forward_mul_mat_f32ggml_task_type: 2
ggml_task_type: 2
ggml_task_type: 2
ggml_compute_forward_mul_mat_f32ggml_task_type: 2
GGML_TASK_FINALIZEGGML_TASK_FINALIZEGGML_TASK_FINALIZEGGML_TASK_FINALIZEGGML_TASK_FINALIZEGGML_TASK_FINALIZEGGML_TASK_FI NALIZEGGML_TASK_FINALIZE
<|BEGIN> <|prompter|>who are you<|endoftext|><|assistant|>Traceback (most recent call last):
File "chat.py", line 30, in
x =generate(my_prompt,args)
File "chat.py", line 14, in generate
x = ai.generate("<|prompter|>"+prompt+"<|endoftext|><|assistant|>", num_tokens_to_generate=arg.tokens)
File "/opt/src/c/cformers/cformers/interface.py", line 228, in generate
token_id = int(token_id_buffer.strip())
ValueError: invalid literal for int() with base 10: 'ggml_compute_forward_mul_mat_f32ggml_task_type:'