tidb-incubator / TiBigData

TiDB connectors for Flink/Hive/Presto
Apache License 2.0
211 stars 57 forks source link

[TiFlash] Introduces TiFlash Source implementation to read the TiFlash data #255

Closed SteNicholas closed 1 year ago

SteNicholas commented 1 year ago

TiFlash is a columnar storage component of TiDB and TiDB Cloud which mainly plays the role of Analytical Processing (AP) in the Hybrid Transactional/Analytical Processing (HTAP) architecture of TiDB. TiSpark currently provides a way to read TiFlash similar to the engine isolation in TiDB, by configuring the parameter spark.tispark.isolation_read_engines. TiFlash Source implementation could be supported via the way refers to the TiSpark.