search

ImadSaddik / DoCamp

5 stars 3 forks source link

Can we build an RAG Android application using Local LLM (HF tflite models) #1

Open puliviswanath opened 3 months ago

puliviswanath commented 3 months ago

I am exploring the development of a Retrieval-Augmented Generation (RAG) application for Android and am considering using local language models from Hugging Face’s TFLite models. I am looking for guidance and insights on how to effectively integrate these models into an Android application.

ImadSaddik commented 3 months ago

Thank you @puliviswanath for raising this issue. I haven't experimented with using HF models on Android before but I think this is a very good idea.

I don't know any good resources to share with you but if I learned anything, I will make sure to tell you and put a video on my channel.

puliviswanath commented 2 months ago

Hi @ImadSaddik , I have done a research on this local LLM, we can achieve this approach with the help of ONNX models and native libs concepts, please let me know we can integrate this into the application shared in this repo

ImadSaddik commented 2 months ago

@puliviswanath here is my discord if you want to share with me your findings Imad_Saddik#9949