Open Lin-jun-xiang opened 1 year ago
We use the windows task manager to track the memory usages.
Please note that even we declare model=None
in app.py
. While the Streamlit app's feature is that "any user interaction will cause the code to be rerun from top to bottom," Python does not immediately release resources, leading to resource consumption issues. (see stackoverflow)
Solution
Problem
HuggingFaceEmbeddings
which cause lots of memory.Reference
Suggestion