Open Betai18n opened 1 year ago
It should be easy to do if you follow this https://github.com/lm-sys/FastChat/blob/main/docs/model_support.md#how-to-support-a-new-model. Could you contribute a PR to fix this?
cc @BlinkDL
simply use User/Assistant instead
# RWKV-4-World default template
register_conv_template(
Conversation(
name="rwkv",
system="",
roles=("User", "Assistant"),
messages=(
("User", "hi"),
(
"Assistant",
"Hi. I am your assistant and I will provide expert full response in full details. Please feel free to ask any question and I will always answer it.",
),
),
offset=2,
sep_style=SeparatorStyle.RWKV,
sep="",
stop_str="\n\n",
)
)
Thanks for your help, it can be used after modification.
Now RWKV-4 World is released, but I find RWKV-world use new prompt template, no longer use Bob/Alice or Q/A, this is completely different from RWKV-raven, so can you support the new template?