Ruby Implementation of Nano Bots: small, AI-powered bots that can be easily shared as a single file, designed to support multiple providers such as Anthropic Claude, Cohere Command, Google Gemini, Maritaca AI, Mistral AI, Ollama, OpenAI ChatGPT, and others, with support for calling tools (functions).
Have you considered LMQL (https://lmql.ai) as a provider? It allows for a more structured outputs, as well as tool use, and it supports both remote providers as well as local models via llama.cpp.
I currently interact with it from Ruby with a slightly modified version of their websocket streaming example, which I can supply if it's useful to you.
PS. Love to see more LLM projects in Ruby, and this is an interesting project
Hi,
Have you considered LMQL (https://lmql.ai) as a provider? It allows for a more structured outputs, as well as tool use, and it supports both remote providers as well as local models via llama.cpp.
I currently interact with it from Ruby with a slightly modified version of their websocket streaming example, which I can supply if it's useful to you.
PS. Love to see more LLM projects in Ruby, and this is an interesting project