support spark catalog

[melin]

support spark catalog

[parisni]

Hi melin. Would that feature allow to create table in the spark catalog (so far only temp table can be created, not real tables) ?

[melin]

You cannot create a table. It facilitates spark sql to access starrocks table

[parisni]

What is the goal of the starrocks catalog if you can't put tables in it ? I thought you meant a starrocks catalogPlugin , same as iceberg, delta or hudi catalog

[melin]

spark catalog 是方便spark sql 直接访问starrocks 中的表。starrocks 是使用mysql 协议，直接使用spark jdbc catalog 也能通过sql 访问starrocks 表，但那样是走jdbc 读取数据，效率不高。参考pingcap 的tispark： https://github.com/pingcap/tispark/blob/master/docs/userguide_3.0.md#write-with-jdbc-datasource

[parisni]

I guess I got it. Once you setup a starrocks catalog in spark you can list/load all the tables in starroks

[melin]

I guess I got it. Once you setup a starrocks catalog in spark you can list/load all the tables in starroks

You are right to understand

[melin]

计划支持吗？