It's an art of the possible which shows how you can consume Phi-3 locally on the edge without using any intranet / internet services, all using file-based ONNX Runtime powered by Semantic Kernel and Kernel Memory. Additionally, if you want, you can additional ingest the online documents to make it a part of your RAG pipeline.
Project Name
Local RAG
Description
It's an art of the possible which shows how you can consume Phi-3 locally on the edge without using any intranet / internet services, all using file-based ONNX Runtime powered by Semantic Kernel and Kernel Memory. Additionally, if you want, you can additional ingest the online documents to make it a part of your RAG pipeline.
Technology & Languages
Project Repository URL
https://github.com/arafattehsin/generative-ai/tree/main/samples/dotnet/local-rag-sk
Deployed Endpoint URL
No response
Project Video
https://arafattehsin.com/wp-content/uploads/2024/08/LocalRAG.gif
Team Members
Arafat Tehsin