Which browser are you using? In case you are using the phone App, specify the Android or iOS version and device please.
No response
Describe the Bug
prompt_style is exposed in 'chat with AI', 'free prompt' response empty.
Chat with AI
admin
Hello
Assistant
im_start|>assistant
Hello! I'm welling to help! Tell me anything you want me to do!
admin
Who are you?
Assistant
Hello! I'm welling to help! Tell me anything you want me to do!
Who are you?
assistant:
admin
What can you do?
Assistant
Hello! I'm welling to help! Tell me anything you want me to do!
Who are you?
Hello! I'm welling to help! Tell me anything you want me to do!
Who are you?
assistant:
What can you do?
assistant:
im_start|>assistant should not be displayed. The sentences are repeated over and over again. The model using a CHATML prompt_style. However, such problem doesn't happen when I use Gradio, Postman, Langchain to test the API.
# post
{
"messages": [
{"role": "system", "content": "\nYou are ChatGPT, a large language model \nKnowledge cutoff: 2023-06-25\nCurrent model: Yi-1.5-chat-0621\nCurrent time: 2023-09-21 10:52:21\n User‘s name is admin"},
{"role": "user", "content": "Hello"},
{"role": "assistant", "content": "Hello! What can I do for you?"},
{"role": "user", "content": "Who are you?"}],
"stream": false,
"model": "Yi-1.5-chat-0621",
"temperature": 0.7,
"presence_penalty": 0,
"frequency_penalty": 0,
"top_p": 0.9
}
Which version of assistant are you using?
1.1.0
Which version of Nextcloud are you using?
v29.0.2
Which browser are you using? In case you are using the phone App, specify the Android or iOS version and device please.
No response
Describe the Bug
prompt_style is exposed in 'chat with AI', 'free prompt' response empty.
Chat with AI
admin
Hello
Assistant
admin
Assistant
admin
Assistant
im_start|>assistant
should not be displayed. The sentences are repeated over and over again. The model using aCHATML
prompt_style. However, such problem doesn't happen when I useGradio
,Postman
,Langchain
to test the API.Expected Behavior
postman
API testThe prompt style doesn't appear in normal post response. How to fix the issue.
To Reproduce
.