jasondavindev / open-dataplatform

Data platform to build batch and real-time ETL flows using only open source technologies.
6 stars 3 forks source link

Delta Lake #16

Closed jasondavindev closed 3 years ago

jasondavindev commented 3 years ago

Track the Delta Lake project. Maybe the Delta Lake can be used to storage layer and take advantage of caching feature.

jasondavindev commented 3 years ago

The Delta Lake implements the Lakehouse concept that solve some problems as massive concurrent access. This project maybe face transactions problems nor ACID requirements, then it is not necessary.