StarRocks / starrocks

StarRocks, a Linux Foundation project, is a next-generation sub-second MPP OLAP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics, and ad-hoc queries.
https://starrocks.io
Apache License 2.0
8.29k stars 1.68k forks source link

[Feature] Support to record external table access #47772

Open Smith-Cruise opened 2 days ago

Smith-Cruise commented 2 days ago

Support to record struct subfield, map_keys.

Will ignore record all columns/partitions scan by default, except when you set enable_full_collect_table_access_statistics=true

When you want to record external table access, you need to set enable_collect_table_access_statistic=true, then you can retrieve access statistics in default_catalog.statistics.table_access_statistics. You can use SQL to analyze which column/partition is a hot spot. Then use cache select to load it into datacache in advance.