Define chat history format using jinja template

hyperonym / basaran

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.

MIT License

1.29k stars 80 forks source link

Define chat history format using jinja template #141

Open peakji opened 1 year ago

peakji commented 1 year ago

Checklist

[ ] Use jinja template to render message history of system, user, and assistant as a prompt for completion.
[ ] Allow specifying template file through environment variable to adapt to formatting requirements of different models.
[x] Provide a reasonable default template.

fardeon commented 1 year ago

Default template added in https://github.com/hyperonym/basaran/pull/163

peakji commented 1 year ago

Message history examples: examples.zip