How can I use a specific prompt template?

c0sogi / llama-api

An OpenAI-like LLaMA inference API

MIT License

111 stars 9 forks source link

Open Dougie777 opened 10 months ago

Dougie777 commented 10 months ago

For example openchat 3.5 wants this prompt template format:

GPT4 User: {prompt}<|end_of_turn|>GPT4 Assistant:

I tried a few things a managed to crash the server so I am stuck. Can anyone help. I think the author is away...