feat: switch chatbot to use local LLaMA model

BrainBlend-AI / atomic-agents

Building AI agents, atomically

MIT License

1.1k stars 87 forks source link

feat: switch chatbot to use local LLaMA model #15

Closed ueveu closed 3 months ago

ueveu commented 3 months ago

Replaced OpenAI client with llama_cpp for local LLaMA model support.
Updated model path to point to local LLaMA model directory.
Ensured compatibility with BaseAgent configuration for LLaMA.

This change allows the chatbot to run using a local LLaMA model instead of relying on OpenAI's API, enabling offline functionality and reducing dependency on external services.

ueveu commented 3 months ago

upon request from https://github.com/BrainBlend-AI/atomic-agents/issues/14

KennyVaneetvelde commented 3 months ago

Thanks!