search

Tencent / Firestorm

Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shuffle data on remote servers
Other
252 stars 72 forks source link

[Bugfix]Fix memory leak & Improve buffer management #215

Closed summaryzb closed 2 years ago

summaryzb commented 2 years ago

What changes were proposed in this pull request?

the behavior of buffer management and memory allocate

Why are the changes needed?

1.fix memory leak, case when adding a huge record to a partition which buffer is not initialized 2.improve buffer management, byte array will be fully used as possible to save memory

Does this PR introduce any user-facing change?

no

How was this patch tested?

through the testing

jerqi commented 2 years ago

Hi @summaryzb , we're moving to new repo https://github.com/apache/incubator-uniffle now, please create a new PR against that repo, thanks!

summaryzb commented 2 years ago

Hi @summaryzb , we're moving to new repo https://github.com/apache/incubator-uniffle now, please create a new PR against that repo, thanks!

thanks for reminding