delta-io / kafka-delta-ingest

A highly efficient daemon for streaming data from Kafka into Delta Lake
Apache License 2.0
337 stars 71 forks source link

made Rust-recommended changes, added cert fixes to Dockerfiles #154

Closed clairewood closed 9 months ago

clairewood commented 9 months ago

In Dockerfile.Debian and Dockerfile.setup -- Added required cert language and used newer version of Rust In src/coercions.rs and src/dead_letters.rs -- Used newer version of chrono and fixed deprecated usage of DateTime in chrono -- timestamp_nanos() was changed to timestamp_nanos_opt() and needed to be unwrapped In docker-compose.yml -- Used older version due to kafka error "redpanda not found" with newer version

rtyler commented 9 months ago

:wave: hey @clairewood did you close this to move it to another pull request?

clairewood commented 9 months ago

Hey @rtyler ! Sorry about that, I'm basically brand new to working on open source projects like this so I didn't actually intend to submit a pull request for these changes quite yet, and I think some of the changes to the Dockerfiles might not be as useful to folks outside of my org. If the other changes sound useful then I can submit a new pull request once I've double-checked everything! Or if there's a better way to go about this then please let me know. Thank you!