apache / gravitino

World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
https://gravitino.apache.org
Apache License 2.0
1.1k stars 345 forks source link

use hive catalog tables insert into doris catalog tables #4484

Open jetliu1711 opened 3 months ago

jetliu1711 commented 3 months ago

Version

main branch

Describe what's wrong

1.I use web ui create doris catalog called doris 2.use spark-sql submit like this: ./spark-sql --conf spark.plugins="com.datastrato.gravitino.spark.connector.plugin.GravitinoSparkPlugin" --conf spark.sql.gravitino.uri=http://localhost:8090 --conf spark.sql.gravitino.metalake=test 3.enter command line :use doris

Error message and/or stacktrace

spark-sql ()> use doris; [SCHEMA_NOT_FOUND] The schema doris cannot be found. Verify the spelling and correctness of the schema and catalog. If you did not qualify the name with a catalog, verify the current_schema() output, or qualify the name with the correct catalog. To tolerate the error on drop use DROP SCHEMA IF EXISTS.

How to reproduce

1.I use web ui create doris catalog called doris 2.use spark-sql submit like this: ./spark-sql --conf spark.plugins="com.datastrato.gravitino.spark.connector.plugin.GravitinoSparkPlugin" --conf spark.sql.gravitino.uri=http://localhost:8090 --conf spark.sql.gravitino.metalake=test 3.enter command line :use doris

Additional context

No response

jerryshao commented 3 months ago

Hi @jetliu1711 thanks for your reporting, I think currently we don't support Doris using Spark connector, can you please confirm this @FANNG1 @zhoukangcn ?

FANNG1 commented 3 months ago

yes, Spark connector doesn't support Doris for now

FANNG1 commented 3 months ago

@caican00 , do you have any plan to support this?