delta-io kafka-delta-ingest issues

delta-io / kafka-delta-ingest

A highly efficient daemon for streaming data from Kafka into Delta Lake

Apache License 2.0

337 stars 71 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Env for ingest args

#177 Nekit2217 closed 1 month ago
0
Build failed on `alpine` because of `rdkafka` `ssl-vendored` instead of `ssl`

#176 thanhminhmr opened 2 months ago
0
Setup basic CI process

#175 Yevhenii-Kozlovskyi1 closed 2 months ago
0
What is the documentation to use HMS as the catalog with delta lake on S3?

#174 alberttwong closed 2 months ago
3
Update deltalake to latest version

#173 qinix opened 3 months ago
0
allow empty transform set

#172 txdv closed 2 months ago
1
chore: update the Dockerfiles to build more cleanly

#171 rtyler closed 1 month ago
0
Docker image build can't find `deltalake-core` dependency

#170 beanscouts closed 1 month ago
2
chore: add truststore certificate as env variable

#168 kortwael opened 4 months ago
1
error: future cannot be sent between threads safely -- dead_letters.rs and writer.rs

#167 clairewood closed 4 months ago
1
Documentation to write data to S3

#166 mayanksingh2298 closed 2 months ago
7
Adding webassembly support

#165 mightyshazam closed 5 months ago
0
Introduce schema evolution via the -S flag

#164 rtyler opened 5 months ago
0
Put avro support behind an optional feature flag

#163 rtyler opened 5 months ago
1
Preparing for deltalake v0.17

#162 rtyler closed 5 months ago
1
Write to multiple delta tables from a single topic

#161 Kikkon opened 6 months ago
3
Upgrade azure dependencies

#160 rtyler closed 6 months ago
0
updated flag retrieval so that it does not always return true

#159 mightyshazam closed 6 months ago
0
end_at_last_offsets flag is always set

#158 kyrre closed 6 months ago
1
feature request: record metrics and export to prometheus

#157 gdubya opened 7 months ago
1
use of deprecated method `chrono::DateTime::<Tz>::timestamp_nanos`: use `timestamp_nanos_opt()` instead

#156 gdubya closed 6 months ago
4
chore: fix some lints added by newer Rust versions

#155 rtyler closed 8 months ago
0
made Rust-recommended changes, added cert fixes to Dockerfiles

#154 clairewood closed 9 months ago
2
Add mode that terminates kdi when the end of a topic is reached

#153 florissmit10 closed 8 months ago
2
Minor README fixes - slack link and Dockerfile.Debian filename

#152 clairewood closed 9 months ago
1
Transform failed (using Azure Event Hubs & ADLS Gen 2 storage account)

#151 Jaegin opened 9 months ago
1
Rebalance handling: reduce time holding write lock on signal

#150 gterzian closed 8 months ago
3
thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value

#149 huyhandes opened 10 months ago
3
Is there support to read images/videos from kafka and push to delta lake

#148 asksonu closed 10 months ago
2
fix: updated parsing of all clap properties

#147 mightyshazam closed 10 months ago
0
unable to run example code: "thread 'main' panicked at 'called `Option::unwrap()` on a `None` value', src\main.rs:91:18"

#146 clairewood closed 10 months ago
2
update docs and argument parsing

#145 mightyshazam closed 10 months ago
0
Getting "unexpected argument" error for all argument IDs when running KDI

#144 clairewood closed 10 months ago
3
Slack link in the readme is expired

#143 lorenzoc25 closed 9 months ago
0
Avro and Schema Registry Support

#142 mightyshazam closed 11 months ago
0
Refactoring tests to be more faster, more better, more stronger

#141 rtyler closed 6 months ago
0
Replace clap macros and upgrade to v4

#140 rtyler closed 1 year ago
0
Upgrade kafka-delta-ingest to use crates.io versions of deltalake

#139 rtyler closed 1 year ago
1
Provide the simplest possible install and getting started instructions

#138 rtyler opened 1 year ago
0
Pull through arrow and parquet dependencies

#137 rtyler closed 1 year ago
0
Enable Azure writes

#136 rtyler closed 1 year ago
3
Add CONTRIBUTING.md file

#135 MrPowers opened 1 year ago
1
Enable Writes to Azure 2

#134 mightyshazam closed 1 year ago
4
Remove clap_app macro and use builder syntax

#133 rportilla-databricks closed 1 year ago
1
Fix this minor nit from clippy to make our builds greener

#132 rtyler closed 1 year ago
0
Demonstrate a bug for schema "validation" when writing JSON to a table

#131 rtyler opened 1 year ago
1
No snapshot or version 0 found

#130 timopetmanson closed 1 year ago
6
Running a general `cargo update`

#129 rtyler closed 1 year ago
0
Fix/remove target from image

#128 denizsurmeli closed 1 year ago
0
Can't write to a table with `DECIMAL(38,0)` field.

#127 denizsurmeli opened 1 year ago
3