Time Travel (querying the historical versions of data) ability for Hudi Table

prestodb / presto

The official home of the Presto distributed SQL query engine for big data

http://prestodb.io

Apache License 2.0

16.06k stars 5.38k forks source link

Time Travel (querying the historical versions of data) ability for Hudi Table #18229

Open china-shang opened 2 years ago

china-shang commented 2 years ago

Does presto support this feature, and if so, what syntax is used?

china-shang commented 2 years ago

https://issues.apache.org/jira/browse/HUDI-1460 ，According to this documentation, is it not supported? Is there a development plan

javrod87 commented 2 years ago

Trino (a fork of Presto) supports the AS OF syntax now for Iceberg and Delta Lake. Don't know of anything yet for Presto. The Hudi connector is about to be added and the support for this will be there once this PR gets merged.

rohanpednekar commented 2 years ago

@china-shang, master Presto does support time travel for Iceberg and Delta Lake and teams are working on getting Time Travel ability added for Hudi Table as well. Trino Delta lake connector was a proprietary solution from Starburst which they open-sourced when Presto Native Delta Lake connector got released to the public so we do not control it. Also, it is not built on delta standalone liabrary

rohanpednekar commented 2 years ago

Also to contribute to Presto product roadmap and shape Presto community, Fill out this survey form at http://tinyurl.com/prestodb and get a free Presto t-shirt. Join https://prestodb.slack.com/ if you have not done already!

rohanpednekar commented 2 years ago

CC @codope @7c00 FYI