search

openlookeng / hetu-core

570 stars 423 forks source link

optimization of partition folder rename operations for ctas and inser… #385

Open chandrasekhar-kambham opened 2 years ago

chandrasekhar-kambham commented 2 years ago

What type of PR is this?

/kind task

What does this PR do / why do we need it:

currently rename partition operations takes a long time during commit operation stage.. optimization of partition folder rename operations for ctas and insert operations. observed 40-50% imporvement in CTAS flow observed ~5% improvement in Insert flow

Which issue(s) this PR fixes:

Fixes #

Special notes for your reviewers:

it-is-a-robot commented 2 years ago

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: chandrasekhar-kambham To complete the pull request process, please assign haochending You can assign the PR to them by writing /assign @haochending in a comment when ready.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files: - **[OWNERS](https://github.com/openlookeng/hetu-core/blob/master/OWNERS)** Approvers can indicate their approval by writing `/approve` in a comment Approvers can cancel approval by writing `/approve cancel` in a comment
it-is-a-robot commented 2 years ago

Welcome @chandrasekhar-kambham!

It looks like this is your first PR to openlookeng/hetu-core 🎉.

You will be prompted by a bot to use commands during the review process. Do not be afraid to follow the prompts! It is okay to experiment. Here is the bot commands documentation.

You can also check if openlookeng/hetu-core has its own contribution guidelines. We want to make sure your contribution gets all the attention it needs!

Thank you, and welcome to MindSpore. :smiley:

chandrasekhar-kambham commented 2 years ago

/check-cla