Open Riddle4045 opened 1 year ago
possibly related to https://github.com/apache/hudi/issues/8038 @codope could you please help me understand how to configure the table for read optimized queries? or is it something that Hudi Sync tool should handle out of the box - Not sure why I am not seeing any rows back.
The compaction is executed async by default every 5 delta_commit on the table, did you have any chance to see the Parquet files already?
The compaction is executed async by default every 5 delta_commit on the table, did you have any chance to see the Parquet files already?
@danny0405 no, there were total 6 deltacommits, no compaction - is there a setting to toggle it? maybe it's turned off by default in Flink? I can also share the .hoodie
folder if it helps you understand what's going on.
Can you show me the running job DAG on the webpage, that would help a lot.
@danny0405 I tried a repro and looks like it compacts now after 5 commits! I guess my cluster might have been flaky during last retry. I can also read the tables now!
That's cool, feel free to give us feedback if you got some new issues.
Tips before filing an issue
Have you gone through our FAQs?
Join the mailing list to engage in conversations and get faster support at dev-subscribe@hudi.apache.org.
If you have triaged this as a bug, then file an issue directly.
Describe the problem you faced TL;DR Trino returns 0 records from hudi table when I can see data in object store.
I am writing hudi tables in ABFS - reduced code
I sync these tables to HMS using Hudi-Sync-Tool.
I can see data streaming into the ABFS location
When I try to query it using Trino my tables have no records
Expected behavior
A clear and concise description of what you expected to happen.
Environment Description