search

zhudotexe / kani

kani (カニ) is a highly hackable microframework for chat-based language models with tool use/function calling. (NLP-OSS @ EMNLP 2023)
https://kani.readthedocs.io
MIT License
557 stars 30 forks source link

Cerebras engine #44

Closed anthoeknee closed 1 month ago

anthoeknee commented 1 month ago

Added a full engine for Cerebras Cloud API to allow for very fast inference times :) enjoy guys