search

pipelinedb / pipeline_kafka

PipelineDB extension for Kafka support
Other
61 stars 22 forks source link

Add flag to enable commit before COPY execution #69

Open derekjn opened 7 years ago

derekjn commented 7 years ago

For certain workloads it may be preferable to commit offsets before executing the COPY into streams in order to prevent repeated execution of events causing failures.

usmanm commented 7 years ago

I think a better approach might be to ignore all errors and continue to commit as is.

derekjn commented 7 years ago

@usmanm crashes?