Proactively remove LRU cache values as cache fills

activeloopai / deeplake

Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai

Mozilla Public License 2.0

7.88k stars 607 forks source link

🚀 🚀 Pull Request

Impact

[X] Bug fix (non-breaking change which fixes expected existing functionality)
[ ] Enhancement/New feature (adds functionality without impacting existing logic)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Description

When loading chunk files from disk, as memory fills the chunk_engine would wait for there to be room to download. Depending on the overall workload, this waiting could last forever.

This change pops a cached value rather than simply wait

activeloopai / deeplake