Hugging Face Chat Templates

zhudotexe / kani

kani (カニ) is a highly hackable microframework for chat-based language models with tool use/function calling. (NLP-OSS @ EMNLP 2023)

https://kani.readthedocs.io

MIT License

560 stars 30 forks source link

Closed zhudotexe closed 2 months ago

zhudotexe commented 2 months ago

Add support for the HuggingEngine to use Hugging Face Chat Templates (https://huggingface.co/docs/transformers/main/en/chat_templating) for HF models without having to construct a PromptPipeline