Open puliviswanath opened 3 months ago
Thank you @puliviswanath for raising this issue. I haven't experimented with using HF models on Android before but I think this is a very good idea.
I don't know any good resources to share with you but if I learned anything, I will make sure to tell you and put a video on my channel.
Hi @ImadSaddik , I have done a research on this local LLM, we can achieve this approach with the help of ONNX models and native libs concepts, please let me know we can integrate this into the application shared in this repo
@puliviswanath here is my discord if you want to share with me your findings Imad_Saddik#9949
I am exploring the development of a Retrieval-Augmented Generation (RAG) application for Android and am considering using local language models from Hugging Face’s TFLite models. I am looking for guidance and insights on how to effectively integrate these models into an Android application.