issues
search
delta-io
/
kafka-delta-ingest
A highly efficient daemon for streaming data from Kafka into Delta Lake
Apache License 2.0
337
stars
71
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
To connect with aws
#126
binodyadav6119
closed
1 year ago
1
Possibility of adding Python bindings to this project
#124
MrPowers
closed
1 year ago
4
Add Dockerfile, update README
#123
caseybrown89
closed
1 year ago
0
Kafka client collaboration
#122
crepererum
opened
1 year ago
3
Upgrade rdkafka to 0.28
#121
xianwill
closed
2 years ago
0
Update latency timer log message to debug
#120
xianwill
closed
2 years ago
0
Add special env var for JSON formatted sasl/scram
#119
xianwill
closed
2 years ago
0
Add a Timeout future to allow flush to happen without a message
#118
xianwill
closed
2 years ago
0
How to ingest the key?
#117
rymail
closed
2 years ago
1
Add in logic for "Create Delta Table if not exist"
#116
mdrakiburrahman
opened
2 years ago
2
Allow manually triggering workflow
#115
thovoll
closed
2 years ago
1
Enable writes to Azure
#114
thovoll
closed
1 year ago
5
Refactor writer::apply_null_counts to reduce nesting
#113
xianwill
closed
2 years ago
0
Improve docs
#112
thovoll
closed
2 years ago
0
Question: How to use an EC2 Instance role for accessing S3/DynamoDB?
#111
xenji
closed
1 year ago
1
Fix cleanup log message
#110
mosyp
closed
2 years ago
0
Bump delta rs
#109
mosyp
closed
2 years ago
0
add dynamic-linking feature
#108
bbigras
closed
2 years ago
8
Upgrade delta-rs to latest
#107
mosyp
closed
2 years ago
0
Bump delta rs
#106
mosyp
closed
2 years ago
0
Add null partition checkpoint read test
#105
mosyp
closed
2 years ago
0
Use hotfix version of delta-rs to address nullable partition values
#104
mosyp
closed
2 years ago
0
Add array type to coercions
#103
mosyp
closed
2 years ago
0
Add coercions_tests and enrich integration tests runner
#102
mosyp
closed
2 years ago
0
Add coercions module for implicit data type coercions
#101
xianwill
closed
2 years ago
0
Find a way to run integration tests in parallel
#100
mosyp
opened
2 years ago
0
Fix clippy
#99
mosyp
closed
2 years ago
0
Add METRICS_PREFIX_VAR_NAME and enhance logging
#98
mosyp
closed
2 years ago
0
Keep last_offset when value buffer is consumed
#97
mosyp
closed
2 years ago
0
Fix parsing seek offset
#96
mosyp
closed
2 years ago
0
Prevent adding already processed offsets to value buffers
#95
mosyp
closed
2 years ago
0
Reorganize modules, enhance logging
#94
mosyp
closed
2 years ago
0
Keep dead_letters table/client on demand
#93
mosyp
opened
2 years ago
1
Add seek-offsets config to set the starting point for the kafka ingestion
#92
mosyp
closed
2 years ago
2
Add info logs to the rebalance event
#91
mosyp
closed
2 years ago
0
Log opts and seek in info level
#90
mosyp
closed
2 years ago
0
no support for gzip?
#89
bbigras
closed
2 years ago
2
Add sentry feature
#88
mosyp
closed
2 years ago
0
Run loop refactor and starting offsets feature
#87
xianwill
closed
2 years ago
0
Bump delta rs version
#86
mosyp
closed
2 years ago
0
Fix the encoding for special cases
#85
mosyp
closed
1 year ago
1
Log creating a checkpoint
#84
mosyp
closed
2 years ago
0
Bumpl delta-rs to latest
#83
mosyp
closed
2 years ago
0
Run loop refactor
#82
xianwill
closed
2 years ago
1
Support starting from explicit partition offsets
#81
xianwill
closed
2 years ago
1
Handle non-acquirable lock error
#80
mosyp
closed
2 years ago
0
Introduce recover_dynamodb_lock
#79
mosyp
closed
2 years ago
2
Handle lag metrics as gauges
#78
xianwill
closed
2 years ago
0
Add lag reporting
#77
xianwill
closed
2 years ago
0
Update delta-rs to pick remove action fix
#76
xianwill
closed
2 years ago
0
Previous
Next