search

openlookeng / hetu-core

570 stars 423 forks source link

need a connector for apache iceberg #38

Open lordk911 opened 3 years ago

lordk911 commented 3 years ago

need a connector for apache iceberg

gravitys169 commented 3 years ago

Hi Kai, Could you please describe your user case? We need know more about the background of this requirement. thanks

---Original--- From: @.> Date: Tue, Jul 27, 2021 14:06 PM To: @.>; Cc: @.***>; Subject: [openlookeng/hetu-core] need a connector for apache iceberg (#38)

need a connector for apache iceberg

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or unsubscribe.

lordk911 commented 3 years ago

Thanks for reply.

"Recently, a set of modern table formats such as Delta Lake, Hudi, Iceberg spring out. Along with Hive Metastore these table formats are trying to solve problems that stand in traditional data lake for a long time with their declared features like ACID, schema evolution, upsert, time travel, incremental consumption etc."

openlookeng have a connector for Hudi, Iceberg is also widely used for build real time data Lake, we use Iceberg too. And Trino(Presto SQL) support for connect to iceberg.