trinodb / trino

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
https://trino.io
Apache License 2.0
9.97k stars 2.88k forks source link

trying to connect hudi from trino #22468

Open Pavan792reddy opened 1 month ago

Pavan792reddy commented 1 month ago

hi ALL, we are trying to connect from trino to read the data from HUDI table . we are able to see the metadata of the hudi table . when we are trying read the table it was in started stated state for more than 30 mins and there is no progress at all , we have checked the logs not able to find any solution we have added the hudi catlogs and restarted the services but no luck.

hudi.properties file details

trino version : 432

connector.name=hudi hive.metastore.uri=thrift://:9083 hive.gcs.json-key-file-path=/home/pavankumar_reddy/key.json

Query :- root@only-trino-test-m:/var/log/trino# trino --catalog hudi --schema default trino:default> select id from avroschema_20 ;

Query 20240621_101924_00006_b6fir, STARTING, 0 nodes, 0 splits

LOG:- 2024-06-21T09:53:17.763Z INFO main io.trino.server.Server ======== SERVER STARTED ======== 2024-06-21T09:56:51.954Z INFO dispatcher-query-5 io.trino.event.QueryMonitor TIMELINE: Query 20240621_095650_00001_b6fir :: FINISHED :: elapsed 1758ms :: planning 393ms :: waiting 170ms :: scheduling 986ms :: running 152ms :: finishing 227ms :: begin 2024-06-21T09:56:50.191Z :: end 2024-06-21T09:56:51.949Z 2024-06-21T09:56:52.405Z INFO dispatcher-query-4 io.trino.event.QueryMonitor TIMELINE: Query 20240621_095645_00000_b6fir :: FINISHED :: elapsed 6326ms :: planning 5693ms :: waiting 255ms :: scheduling 283ms :: running 10ms :: finishing 340ms :: begin 2024-06-21T09:56:46.078Z :: end 2024-06-21T09:56:52.404Z 2024-06-21T09:56:52.606Z INFO dispatcher-query-5 io.trino.event.QueryMonitor TIMELINE: Query 20240621_095652_00002_b6fir :: FINISHED :: elapsed 143ms :: planning 65ms :: waiting 0ms :: scheduling 30ms :: running 41ms :: finishing 7ms :: begin 2024-06-21T09:56:52.452Z :: end 2024-06-21T09:56:52.595Z

alberttwong commented 1 month ago

Try Trino 418 per https://github.com/trinodb/trino/pull/18840#issuecomment-1772069499