amikos-tech / chromadb-data-pipes

ChromaDB Data Pipes 🖇️ - The easiest way to get data into and out of ChromaDB
https://datapipes.chromadb.dev/
MIT License
8 stars 1 forks source link

Multi-threaded import issue: RuntimeError: cannot schedule new futures after shutdown #99

Closed tazarov closed 5 months ago

tazarov commented 5 months ago

Raised with a very small batch (e.g. 10) which is below the default batch 100, thus resulting in out-of-loop submission to the thread pool.

RCA - Happens due to wrong indentation