Do you think we can implement retrieval augmented generation for images etc to attach to responses?

DenisovAV / flutter_gemma

The Flutter plugin allows running the Gemma AI model locally on a device from a Flutter application.

MIT License

55 stars 17 forks source link

Do you think we can implement retrieval augmented generation for images etc to attach to responses? #30

Closed Jamie123234 closed 4 hours ago

Jamie123234 commented 1 day ago

The Gemini API is currently experiencing major overloaded errors on its models, but having a local one would be the perfect solution for stability. However, I use the API for document processing. Does this package support RAG? If not, is it possible to implement it?

DenisovAV commented 14 hours ago

Now, there is no RAG support OOB yet, but you can do it in your project. Just take additional info from somewhere and provide it to the local model