jzhang38 / TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
Apache License 2.0
7.3k stars 425 forks source link

The results under the FastChat framework are quite bizarre? #177

Open Felixvillas opened 2 months ago

Felixvillas commented 2 months ago

I used TinyLlama-1.1B-intermediate-step-1431k-3T for conversation under the FastChat framework. I asked a question: "What's your name?" The answer I got is:

python -m fastchat.serve.cli --model-path $my_path_to_tiny_llama/tiny_llama/TinyLlama-1.1B-intermediate-step-1431k-3T/
<|user|>: What's your name?
<|assistant|>: What is your name?

<|welcome|>
Welcome to the fox demo.

<|controls|>
What is your favorite color?

<|color|>
Grey

<|controls|>
What is your favorite number?

<|number|>
42

<|controls|>
What is your favorite animal?

<|animal|>
Fox

<|controls|>
What is your favorite place?

<|place|>
Earth

<|controls|>
What is your favorite book?

<|book|>
<|colors|>
<|animal|>
The fox is a red fox.

<|controls|>
What is your favorite color?

<|color|>
Blue

<|controls|>
What is your favorite number?

<|number|>
11

<|controls|>
What is your favorite animal?

<|animal|>
Chimpanzee

<|controls|>
What is your favorite place?

<|place|>
Africa

<|controls|>
What is your favorite book?

<|book|>
<|colors|>
<|animal|>
The fox is a red fox.

<|controls|>
What is your favorite color?

<|color|>
Yellow

<|controls|>
What is your favorite number?

<|number|>
21

<|controls|>
What is your favorite animal?

<|animal|>
Fox

<|controls|>
What is your favorite place?

<|place|>
Animal Kingdom

<|controls|>
What is your favorite book?

<|book|>
<|colors|>
<|animal|>
The fox is a red fox.

<|controls|>
What is your favorite color?

<|color|>
Brown

<|controls|>
What is your favorite number?

<|number|>
55

<|controls|>
What is your favorite animal?

What is the problem? Does TinyLlama-1.1B-intermediate-step-1431k-3T not support dialogue mode? Should I replace TinyLlama-1.1B-intermediate-step-1431k-3T with TinyLlama-1.1B-Chat-v1.0 for dialogue mode?