Memory Leaks during batch point inserts

qdrant / qdrant-js

JavaScript/Typescript SDK for Qdrant Vector Database

https://qdrant.tech

Apache License 2.0

240 stars 23 forks source link

Memory Leaks during batch point inserts #52

Open PJanko opened 11 months ago

PJanko commented 11 months ago

Hello

I'm using the library using the REST client to batch insert points (by 1000) in a cloud QDrant cluster. After 185000 points inserted my script crashed, running out of heap. (the node process was using 4GB of memory at that time)

I can not deep dive into the issue, but I was able to perform my task using the REST API directly.

Regards

hiepxanh commented 7 months ago

increase memory limit using:

MacOS:

export NODE_OPTIONS="--max-old-space-size=8192"

-----------------------------------------------

Windows:

set NODE_OPTIONS="--max-old-space-size=8192"

can help you prevent memory leak, BTW you need batch update

Rendez commented 6 months ago

Could you please share a showcase with the specific example causing this?