search

Maximilian-Winter / llama-cpp-agent

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
Other
472 stars 42 forks source link

Add support for openAI LLM #71

Open Anash3 opened 3 months ago

umiyuki commented 2 months ago

OpenAI now supports Structured Outputs mode in its API. This may be very compatible with llama-cpp-agent; it would be helpful to have such an option to allow people without GPUs to use the application. https://openai.com/index/introducing-structured-outputs-in-the-api/

Maximilian-Winter commented 2 months ago

@umiyuki I'm working on a unified framework https://github.com/Maximilian-Winter/ToolAgents

umiyuki commented 2 months ago

I was not aware of the ToolAgents project. Great project! Looks very good.