I used TinyLlama-1.1B-intermediate-step-1431k-3T for conversation under the FastChat framework. I asked a question: "What's your name?" The answer I got is:
python -m fastchat.serve.cli --model-path $my_path_to_tiny_llama/tiny_llama/TinyLlama-1.1B-intermediate-step-1431k-3T/
<|user|>: What's your name?
<|assistant|>: What is your name?
<|welcome|>
Welcome to the fox demo.
<|controls|>
What is your favorite color?
<|color|>
Grey
<|controls|>
What is your favorite number?
<|number|>
42
<|controls|>
What is your favorite animal?
<|animal|>
Fox
<|controls|>
What is your favorite place?
<|place|>
Earth
<|controls|>
What is your favorite book?
<|book|>
<|colors|>
<|animal|>
The fox is a red fox.
<|controls|>
What is your favorite color?
<|color|>
Blue
<|controls|>
What is your favorite number?
<|number|>
11
<|controls|>
What is your favorite animal?
<|animal|>
Chimpanzee
<|controls|>
What is your favorite place?
<|place|>
Africa
<|controls|>
What is your favorite book?
<|book|>
<|colors|>
<|animal|>
The fox is a red fox.
<|controls|>
What is your favorite color?
<|color|>
Yellow
<|controls|>
What is your favorite number?
<|number|>
21
<|controls|>
What is your favorite animal?
<|animal|>
Fox
<|controls|>
What is your favorite place?
<|place|>
Animal Kingdom
<|controls|>
What is your favorite book?
<|book|>
<|colors|>
<|animal|>
The fox is a red fox.
<|controls|>
What is your favorite color?
<|color|>
Brown
<|controls|>
What is your favorite number?
<|number|>
55
<|controls|>
What is your favorite animal?
What is the problem? Does TinyLlama-1.1B-intermediate-step-1431k-3T not support dialogue mode? Should I replace TinyLlama-1.1B-intermediate-step-1431k-3T with TinyLlama-1.1B-Chat-v1.0 for dialogue mode?
I used
TinyLlama-1.1B-intermediate-step-1431k-3T
for conversation under the FastChat framework. I asked a question: "What's your name?" The answer I got is:What is the problem? Does
TinyLlama-1.1B-intermediate-step-1431k-3T
not support dialogue mode? Should I replaceTinyLlama-1.1B-intermediate-step-1431k-3T
withTinyLlama-1.1B-Chat-v1.0
for dialogue mode?