DarioBalinzo / kafka-connect-elasticsearch-source

Kafka Connect Elasticsearch Source
Apache License 2.0
65 stars 38 forks source link

Index Prefix is not working as intended, it is copying all the indices #104

Open gauti251988 opened 1 year ago

gauti251988 commented 1 year ago

{ "name": "ElasticSourceConnectorConnector_1", "config": { "topic.creation.default.partitions": "3", "topic.creation.default.replication.factor": "2", "topic.creation.enable": "false", "name": "ElasticSourceConnectorConnector1", "connector.class": "com.github.dariobalinzo.ElasticSourceConnector", "tasks.max": "1", "errors.log.enable": "true", "errors.log.include.messages": "true", "topic.creation.groups": "", "es.host": "**", "es.scheme": "https", "es.port": "****", "es.user": "*", "es.password": "***", "es.tls.keystore.location": "", "es.tls.keystore.password": "", "es.tls.truststore.location": "**", "es.tls.truststore.password": "****", "index.prefix": ".ds-logs-okta.system-default", "index.names": "", "mode": "timestamp", "incrementing.field.name": "@timestamp", "batch.max.rows": "100", "topic.prefix": "ELASTIC", "fieldname_converter": "nop" } }

I see the curl call for fetching all indices but it doesn't use the prefix to filter the index we are interested in.