trinodb / trino

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
https://trino.io
Apache License 2.0
9.88k stars 2.86k forks source link

Using the Hive Metastore with Kudu trino work error #10750

Open liuzx8888 opened 2 years ago

liuzx8888 commented 2 years ago

I follow this page config . It looks as if the configuration was successful.

https://kudu.apache.org/docs/hive_metastore.html#enabling-the-hive-metastore-integration

kudu master start log
I1115 18:51:37.391942  1832 catalog_manager.cc:1253] Loading table and tablet metadata into memory...
I1115 18:51:37.392135  1832 catalog_manager.cc:495] Loaded metadata for table $schemas [id=9c31d249228f42b38468835a7ae2c6e6]
I1115 18:51:37.392266  1832 catalog_manager.cc:549] Loaded metadata for tablet 1526622b192145b8973fc852c2cfbd8f (table $schemas [id=9c31d249228f42b38468835a7ae2c6e6])
I1115 18:51:37.392287  1832 catalog_manager.cc:549] Loaded metadata for tablet 2842be87bec74f0592a01ca0535bd9aa (table $schemas [id=9c31d249228f42b38468835a7ae2c6e6])
I1115 18:51:37.392294  1832 catalog_manager.cc:1262] Initializing Kudu cluster ID...
I1115 18:51:37.392381  1832 catalog_manager.cc:1098] Loaded cluster ID: 70b19944b04543759922355e6ce259ac
I1115 18:51:37.392387  1832 catalog_manager.cc:1273] Initializing Kudu internal certificate authority...
I1115 18:51:37.392593  1832 catalog_manager.cc:1282] Loading token signing keys...
I1115 18:51:37.392693  1832 catalog_manager.cc:5093] T 00000000000000000000000000000000 P 2bc3b2318ca640a78a99fcbe4d058a9f: Loaded TSK: 0
I1115 18:51:37.392736  1832 catalog_manager.cc:1292] Initializing in-progress tserver states...
I1115 18:51:37.392812  1832 catalog_manager.cc:1305] Loading latest processed Hive Metastore notification log event ID... 

Now I use trino to connect to kudu and execute the following script。

trino:default> create schema cdr;
CREATE SCHEMA
trino:default> use cdr;
USE
trino:cdr> show schemas;
       Schema       
--------------------
 cdr                
 default            
 information_schema 
(3 rows)Query 20211118_033415_00020_4gwuw, FINISHED, 3 nodes
Splits: 36 total, 36 done (100.00%)
0.22 [3 rows, 43B] [13 rows/s, 195B/s] 

trino:cdr> CREATE TABLE kudu.cdr.users (
        ->   user_id int WITH (primary_key = true),
        ->   first_name varchar,
        ->   last_name varchar
        -> ) WITH (
        ->   partition_by_hash_columns = ARRAY['user_id'],
        ->   partition_by_hash_buckets = 2
        -> );
        ->  
W1118 13:56:00.671370 31226 catalog_manager.cc:1959] Remote error: failed to create HMS catalog entry for table [id=3490249b929842509d3364a18f07a4e5]: failed to create Hive MetaStore table: TException - service has thrown: MetaException(message=NoSuchObjectException(message:cdr))

kudu master log:

W1118 13:56:00.671370 31226 catalog_manager.cc:1959] Remote error: failed to create HMS catalog entry for table [id=3490249b929842509d3364a18f07a4e5]: failed to create Hive MetaStore table: TException - service has thrown: MetaException(message=NoSuchObjectException(message:cdr))

Schemas Failed to synchronize to hive metadata,If I create this database in hive,the error log:

W1118 13:30:00.148990 31226 catalog_manager.cc:1959] Remote error: failed to create HMS catalog entry for table [id=4a40e0c12d9a4d26a11fcce0cf259d35]: failed to create Hive MetaStore table: TException - service has thrown: MetaException(message=java.lang.IllegalArgumentException: Can not create a Path from an empty string)

follow this page https://trino.io/docs/current/connector/kudu.html image

liuzx8888 commented 2 years ago

@Crossoverrr such as #5601

liuzx8888 commented 2 years ago

@findepi please help me look this question