Insertion uses all memory

microsoft / ALEX

A library for building an in-memory, Adaptive Learned indEX

MIT License

656 stars 112 forks source link

Insertion uses all memory #30

Open minway opened 1 year ago

minway commented 1 year ago

Hi all,

In my PySpark script, I call ALEX to insert around 1 million records. In some cases, ALEX uses all memory and the program crashes. I am still trying to figure out the specific cause. I wonder if anyone has similar issues. Any input is appreciated.

Bests,