The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
This PR refactors the whole codebase and adds the new providers, the TGI server and vllm server. It completely reworks the way to interact with the LlamaCppAgent class.
This PR refactors the whole codebase and adds the new providers, the TGI server and vllm server. It completely reworks the way to interact with the LlamaCppAgent class.