search

acon96 / home-llm

A Home Assistant integration & Model to control your smart home using a Local LLM
483 stars 56 forks source link

command-r+phi prompt templates #141

Closed StefanDanielSchwarz closed 1 month ago

StefanDanielSchwarz commented 1 month ago

Added prompt templates for Command-R and Phi models.

(By the way, Command-R+ works really well with RAG and function calling, perfect for Home Assistant integration!)

When merged, this will resolve at least a part of https://github.com/acon96/home-llm/issues/139

acon96 commented 1 month ago

The zephyr3 prompt format (shows up as Zephyr (<|end|>) in the UI) is supposed to be what the Phi-3 instruct models use. Can you remove the phi-3 format from this PR? The newline difference between the two is added by another function

The Command-R one is a good addition, thanks for that.

StefanDanielSchwarz commented 1 month ago

OK, done.