Insertion uses all memory

microsoft / ALEX

A library for building an in-memory, Adaptive Learned indEX

MIT License

668 stars 115 forks source link

Insertion uses all memory #30

Open minway opened 2 years ago

minway commented 2 years ago

Hi all,

In my PySpark script, I call ALEX to insert around 1 million records. In some cases, ALEX uses all memory and the program crashes. I am still trying to figure out the specific cause. I wonder if anyone has similar issues. Any input is appreciated.

Bests,