[Tech Request]: reduce allocations in btree

matrixorigin / matrixone

Hyperconverged cloud-edge native database

https://docs.matrixorigin.cn/en

Apache License 2.0

1.71k stars 270 forks source link

[Tech Request]: reduce allocations in btree #12820

Open reusee opened 8 months ago

reusee commented 8 months ago

Is there an existing issue for the same tech request?

[X] I have checked the existing issues.

Does this tech request not affect user experience?

[X] This tech request doesn't affect user experience.

What would you like to be added ?

The btree package allocates too much memory and causes high GC pressure. We should optimize it.

Why is this needed ?

No response

Additional information

No response

reusee commented 8 months ago

btree forked and optimized https://github.com/matrixorigin/btree

reusee commented 5 months ago

I'm planning to add another layer of versioning. Instead of copying on every write, we maintain multiple versions and do copying as needed. Doing this will reduce allocations.