LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.34k stars 310 forks source link

Help: How to set Phi-3 prompt template? #924

Closed LeMoussel closed 2 weeks ago

LeMoussel commented 2 weeks ago

I want to use bartowski/Phi-3-medium-128k-instruct-GGUF. Prompt format: <|user|> {prompt}<|end|><|assistant|><|end|>

In settings I can't find anything about Phi-3 prompt. So, I think I should choose [custom], but what should I complete? Does I set

Thank you for your help

image

LostRuins commented 2 weeks ago

Phi 3 prompt will be added in the next version. For now, you can use this:

start seq = <|end|><|user|>\\n end seq = <|end|>\\n<|assistant|>