search

pingcap / tidb

TiDB is an open-source, cloud-native, distributed, MySQL-Compatible database for elastic scale and real-time analytics. Try AI-powered Chat2Query free at : https://www.pingcap.com/tidb-serverless/
https://pingcap.com
Apache License 2.0
37.13k stars 5.83k forks source link

use external storage to reduce the memory space usage of some executors #14392

Open XuHuaiyu opened 4 years ago

XuHuaiyu commented 4 years ago

Feature Request

Is your feature request related to a problem? Please describe:

As the title says.

Describe the feature you'd like:

issue difficulty assignee PRs
  • [ ] #TODO Use external storage for Index Merge Join
hard help wanted N/A
  • [ ] #14675 implement grace hash join for Hash Join to avoid OOM of hash table
hard help wanted N/A
  • [ ] #14413 Use external storage for Hash Aggregation
hard help wanted N/A
  • [ ] #14395 Use external storage for Distinct
hard help wanted N/A
  • [x] #12431 Use external storage for Sort
medium @wshwsh12 #13718, #14279
  • [ ] #TODO Use external storage for Window Function
medium help wanted N/A
  • [ ] #TODO Compare between row-based and vectorized external storage format for different executors
hard help wanted N/A

Describe alternatives you've considered:

Teachability, Documentation, Adoption, Migration Strategy:

Tjianke commented 3 years ago

Hello, I'm interested in implementing external storage for window function, is it still needed(As I noticed window function already has sliding window implemented in #14294)?