dodeeric / langchain-ai-assistant-with-hybrid-rag

This is a LLM chatbot coded with LangChain. The web interface is coded with Streamlit. It implements a hybrid RAG (keyword and semantic search) and chat memory.
https://bmae-ragai-webapp.azurewebsites.net
GNU General Public License v3.0
8 stars 1 forks source link

add again st.cache for the instanciate_ai_assistant_chain? #73

Closed dodeeric closed 2 weeks ago

dodeeric commented 2 weeks ago

@st.cache_resource

def instanciate_ai_assistant_chain(model, temperature):

without cache:

admin --> assistant --> admin --> assistant --> ... ===> the function is each time run (running some seconds) (try on streamlit community cloud because it is slower than the vm)

dodeeric commented 2 weeks ago

seems faster now