A model-agnostic Ruby Generative AI DSL and framework. Provides base classes for building Generators, Actions, Tasks, and Agents that can be used to build AI powered applications in Ruby.
We found the json formatting flag in the Ollama docs trying to fix the Llama3.1 provider and it made me wonder if that was what's causing the issues with the Gemini models.
In the process, found their new JSON mode to test out and it worked flawlessly on all our tests with minimal changes to the provider.
This flag isn't supported in any of the older models, but at least works in the main ones - gemini-1.5-flash and gemini-1.5-pro.
Still want to poke at it for other use cases for a bit to feel good about taking the "experimental" flag off and adding it to the CLI project generator, but this seems like a big improvement to what we already have, given #46
AndrewBKang
commented
1 month ago
We found the json formatting flag in the Ollama docs trying to fix the Llama3.1 provider and it made me wonder if that was what's causing the issues with the Gemini models.
In the process, found their new JSON mode to test out and it worked flawlessly on all our tests with minimal changes to the provider.
This flag isn't supported in any of the older models, but at least works in the main ones -
gemini-1.5-flashandgemini-1.5-pro.Still want to poke at it for other use cases for a bit to feel good about taking the "experimental" flag off and adding it to the CLI project generator, but this seems like a big improvement to what we already have, given #46