search

mt7180 / quaigle

RAG-based LLM application: project to explore different llm-frameworks like llamaindex, marvin and langchain, other used frameworks: streamlit, fastapi
1 stars 1 forks source link

persist token usage (per user) and load into st.session_state #37

Open mt7180 opened 1 year ago

mt7180 commented 1 year ago 
          added a  streamlit bar chart to visualize the token usage of the current session. The token usage is currently not persisted and will remain an open todo for future

Originally posted by @mt7180 in https://github.com/mt7180/quaigle/issues/36#issuecomment-1750356709