pingcap / tiflash

The analytical engine for TiDB and TiDB Cloud. Try free: https://tidbcloud.com/free-trial
https://docs.pingcap.com/tidb/stable/tiflash-overview
Apache License 2.0
936 stars 409 forks source link

Reduce memory usage for EstablishDisaggRequest #9135

Open breezewish opened 4 weeks ago

breezewish commented 4 weeks ago

Enhancement

image

EstablishDisaggRequest serializes ColumnFileInMemory into the gRPC request, so that it can use memory very quickly. In the example above, each Establish request eats ~70MB.