delta-io / kafka-delta-ingest

A highly efficient daemon for streaming data from Kafka into Delta Lake
Apache License 2.0
337 stars 71 forks source link

Upgrade kafka-delta-ingest to use crates.io versions of deltalake #139

Closed rtyler closed 1 year ago

rtyler commented 1 year ago

This change is long overdue and moves kafka-delta-ingest towards using specific released versions of deltalake rather than mystery SHA1s from the git repo.

Additionally, rather than move from Decoder to RawDecoder in this commit, I will be doing that in a follow up and so this allows some deprecated APIs for the moment

houqp commented 1 year ago

looks like build is failing due to rustfmt errors