confluentinc / kafka-connect-elasticsearch

Kafka Connect Elasticsearch connector
Other
15 stars 436 forks source link

Suggestion for INSERT operation "Ignoring EXTERNAL version conflict for operation INDEX on document" #709

Open ramyogi7283 opened 1 year ago

ramyogi7283 commented 1 year ago

Any suggestion can be provide to resolve the Ignoring EXTERNAL version conflict for operation INDEX on document

Whether Kafka level or connector level ?

write.method=UPSERT works find for not sending version external. But as per the code. DELETE still sends version so it is causing the DELETE ignoring issue. when record value NULL. I am confused this logic. How to avoid DELETE with EXTERNAL version send and if change UPSERT then again index or updating documents causing issue.

final String id = config.shouldIgnoreKey(record.topic()) ? String.format("%s+%d+%d", record.topic(), record.kafkaPartition(), record.kafkaOffset()) : convertKey(record.keySchema(), record.key());

// delete if (record.value() == null) { return maybeAddExternalVersioning(new DeleteRequest(index).id(id), record); }