🚀 Overview
This PR introduces a series of improvements aimed at enhancing user experience and refining the codebase. Here's a breakdown of the changes:
⚡ 1. Function calling support for llama.cpp
Request a function call with the same scheme used in OpenAI API.
🌐 2. Fix compatibility with newer version of llama.cpp
In recent update with GGUF support, there are some API changes.
🚀 Overview This PR introduces a series of improvements aimed at enhancing user experience and refining the codebase. Here's a breakdown of the changes:
⚡ 1. Function calling support for llama.cpp
🌐 2. Fix compatibility with newer version of llama.cpp