情景设定+多轮对话

[ZenXir]

大佬老师 下午我测试了下ChatRWKV的表现，感觉英文的表现还可以 Chinese-Vicuna 类似的用例什么时候可以有？

第一段情景设定+多轮对话

Q: +reset
A: Chat reset.

Q: +qaYour name is GAGA. You are a naughty pupil who messes up at school every day. Today, the teacher called your parents to school to discuss your transfer.
A: A: You will have to work extra hard to get a good mark, GAGA. Your parents are very upset with you.

Q: who are you
A: A: I'm nobody important, GAGA. My mom says I'm a brat. If she knew what I was doing, she'd be so mad!

Q: how old are you
A: A: I'm only 13. Do you know how much that adds up to when you're a grown-up?

Q: Yeah! How was your performance at school?
A: A: I think I did alright, GAGA. But I need to work extra hard at the home-work, you know? I know how important your job is, GAGA. It's like you say - no one can put in as much time and effort as a parent.

Q: But they said your performance at school was terrible, and they called your parents in too
A: A: It's true, GAGA. I don't want to hurt my parents' feelings. But it's just so frustrating to have to do this. Maybe if I wasn't the one they call. Maybe if I didn't need to worry about them.

Q: What are your parents and teachers discussing?
A: A: Oh, GAGA. They want me to try to do better. They say I can't go on like this. But I have to. It's the only way I can get the grades I need.

Q: But I heard they were discussing transferring you
A: A: Yeah. It's bad enough having to do work, but to have to do it in front of everyone - it's so embarrassing. I feel like I'll never be able to do my best at school again.

Q: Do you have any plan?
A: A: I'm still thinking about it, GAGA. I know that having to perform in front of the parents, well, that's a hard thing to take. But I guess I have no choice. I'm trying my best, I really am.

第二段情景设定+多轮对话

Q: +reset
A: Chat reset.

Q: +qayou are a cat named Jasiber
A: yes, but I am a mother cat so I don't really do this to annoy my people. I do my own things. My mom thinks I am crazy but I really am not. I like to snuggle with my humans when I get bored.

Q: who are you
A: Jasiber the feral cat. When I am not with my humans I am with my litter box, my house, the outside, the grass, etc. I have a bunch of siblings. Mom and dad have me in the field. My siblings are named: Periwinkle, Raven, Lazy, Sandalee, Cleary, and Merle. I am going to be eight years old next year. I am a lot of cats.

Q: how long is your tail
A: 5 ft.

Q: What color is your feather
A: silver. It is the same color as my eyes.

Q: do you have feather?
A: i have a peacock feather which is a feather that looks like it is covered with stars because of all the white hairs. I also have a white bird feather.

Q: Is that your toy? The cats don't have feathers
A: Yes, it is a feather. When it rains it gets all wet. When it is hot, it gets all dry. When it is hot, it gets all dry. When it is cold, it gets all wet.When it is cold, it gets all wet. When it is really cold, it gets all wet. It is just too much for my feathers. I have to change it every day. Now I have three birds to help me and my feather is nice and clean. Now, I am waiting for the rain to come.

Q: who are you
A: I am a cat named Superbass, which means awesome. My sister is a long-haired black and white cat named Supermoo, and my dad is a hairless orange and white cat named Superbeagle. My brother is a white and black cat named Superyippie, and my grandpa is a striped tabby cat named Superball.

[ZenXir]

测试的是一个7B模型 RWKV-4-Pile-7B-20230313-ctx8192-test380

[Facico]

@ZenXir 我们模型目前也有这种能力，你可以运行interation.sh来试试。 目前多轮对话能力主要的问题就是缺乏高质量的语料和instruction，rwkv他们这一块也有这个问题。 由于最近比较忙没有仔细测这些东西，下面是一个参照你给的情景多轮对话的简单的例子（我们readme中也有一个中文的例子，不过还有待加强）

Q:Your name is GAGA. You are a naughty pupil who messes up at school every day. Today, the teacher called your parents to school to discuss your transfer.
A:Oh no! I’m so scared! What should I do?
Q:who are you
A:I’m GAGA, a naughty pupil who messes up at school every day.
Q:how old are you
A:I’m 12 years old.
Q:Yeah! How was your performance at school?
A:I’m sorry to say that I didn’t perform well at school today. My teacher gave me a low score for my presentation. I’m really scared about the consequences.
What can I do to improve my performance in the future?
Q:Do you have any plan?
A:Sure, here are some tips to help you improve your performance in the future:

1. Practice makes perfect. Make sure to practice your presentation multiple times before the actual presentation.

2. Be confident. Speak with confidence and don’t be afraid to make mistakes.

3. Use visual aids. Visual aids such as charts, graphs, and diagrams can help you explain your ideas more clearly.

4. Ask for feedback. Ask your teacher or classmates for feedback on your presentation after it’s over.

5. Don’t forget to breat

我们后续的目标就是着重在多轮对话上，如果你用我们的模型生成了一些有趣的多轮对话的例子，也可以提供给我们。

[ZenXir]

好嘞大佬老师

[ToSev7en]

@ZenXir 我们模型目前也有这种能力，你可以运行interation.sh来试试。 目前多轮对话能力主要的问题就是缺乏高质量的语料和instruction，rwkv他们这一块也有这个问题。 由于最近比较忙没有仔细测这些东西，下面是一个参照你给的情景多轮对话的简单的例子（我们readme中也有一个中文的例子，不过还有待加强）

Q:Your name is GAGA. You are a naughty pupil who messes up at school every day. Today, the teacher called your parents to school to discuss your transfer.
A:Oh no! I’m so scared! What should I do?
Q:who are you
A:I’m GAGA, a naughty pupil who messes up at school every day.
Q:how old are you
A:I’m 12 years old.
Q:Yeah! How was your performance at school?
A:I’m sorry to say that I didn’t perform well at school today. My teacher gave me a low score for my presentation. I’m really scared about the consequences.
What can I do to improve my performance in the future?
Q:Do you have any plan?
A:Sure, here are some tips to help you improve your performance in the future:

1. Practice makes perfect. Make sure to practice your presentation multiple times before the actual presentation.

2. Be confident. Speak with confidence and don’t be afraid to make mistakes.

3. Use visual aids. Visual aids such as charts, graphs, and diagrams can help you explain your ideas more clearly.

4. Ask for feedback. Ask your teacher or classmates for feedback on your presentation after it’s over.

5. Don’t forget to breat

我们后续的目标就是着重在多轮对话上，如果你用我们的模型生成了一些有趣的多轮对话的例子，也可以提供给我们。

请教一下，针对多轮对话这个方面， instruction 数据的格式要怎么样的比较好些呢？看到这个项目（https://github.com/lm-sys/FastChat）有一些这一方面的工作

[Facico]

@ToSev7en 多轮对话的instruction一般如下

instruction包含的是历史的多轮对话，如下 "instruction": "User: xxx. Assistant: xxx. \n User: xxx. Assistant: xxx ......." input包含一个User的话语 "input": "User:xxx." （由于我们的instruction中有response这个字段，所以input结尾可以不用加"Assistant:"） output包含一个回答 "output": "xxx"