Add Prompt templating structures - Githubissues

getnamo / Llama-Unreal

Llama.cpp plugin for Unreal Engine 5

MIT License

41 stars 5 forks source link

Add Prompt templating structures #3

Open getnamo opened 10 months ago

getnamo commented 10 months ago

Not sure exactly how, but a better API for setting up various use cases:

General chat interaction structure and reliable EOS tags
Thought chains
Assistant
Roleplay
External API calls e.g. a function call interpretation by LLM with injected results.

Base chat templating support e.g.

[x] ChatML
[ ] Alpaca
[ ] llama