lm-sys / FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Apache License 2.0
36.57k stars 4.52k forks source link

RWKV-raven and RWKV-world have different prompt template #1929

Open Betai18n opened 1 year ago

Betai18n commented 1 year ago

Now RWKV-4 World is released, but I find RWKV-world use new prompt template, no longer use Bob/Alice or Q/A, this is completely different from RWKV-raven, so can you support the new template?

merrymercy commented 1 year ago

It should be easy to do if you follow this https://github.com/lm-sys/FastChat/blob/main/docs/model_support.md#how-to-support-a-new-model. Could you contribute a PR to fix this?

cc @BlinkDL

BlinkDL commented 1 year ago

simply use User/Assistant instead

# RWKV-4-World default template
register_conv_template(
    Conversation(
        name="rwkv",
        system="",
        roles=("User", "Assistant"),
        messages=(
            ("User", "hi"),
            (
                "Assistant",
                "Hi. I am your assistant and I will provide expert full response in full details. Please feel free to ask any question and I will always answer it.",
            ),
        ),
        offset=2,
        sep_style=SeparatorStyle.RWKV,
        sep="",
        stop_str="\n\n",
    )
)
Betai18n commented 1 year ago

Thanks for your help, it can be used after modification.