search

Mobile-Artificial-Intelligence / maid_llm

maid_llm is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)
MIT License
29 stars 8 forks source link

Custom prompt format #6

Closed danemadsen closed 1 month ago

danemadsen commented 2 months ago

Discussed in https://github.com/Mobile-Artificial-Intelligence/maid/discussions/521

Originally posted by **patrickmac110** April 27, 2024 I'd like to run other models like Phi-3, but there's no option for custom prompt formats like <|user|>\nQuestion <|end|>\n<|assistant|>