Open aasimali141290 opened 1 year ago
Hi @aasimali141290 , thanks for updating. I have some questions. Maybe @irtiza07 also can check on this. debezium/connect:1.4 supports avro, but later debezium (after 2.0) does not. it requires a more complex code to setup the maven jar files from confluence in the image. I see those lines are removed from here. but i see avroconnector improves performance. should it really need to be removed from the original code?
services: postgres: image: debezium/postgres:15 ports:
POSTGRES_DB=exampledb
zookeeper: image: confluentinc/cp-zookeeper:7.5.1 environment: ZOOKEEPER_CLIENT_PORT: 2181
kafka: image: confluentinc/cp-enterprise-kafka:7.5.1 depends_on: [zookeeper] environment: KAFKA_ZOOKEEPER_CONNECT: "zookeeper:2181" KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://kafka:9092 KAFKA_INTER_BROKER_LISTENER_NAME: PLAINTEXT # Set the security protocol explicitly KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: PLAINTEXT:PLAINTEXT,PLAINTEXT_HOST:PLAINTEXT
KAFKA_BROKER_ID: 1 KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1 KAFKA_JMX_PORT: 9991 ports:
9092:9092
debezium: image: debezium/connect:2.4 environment: BOOTSTRAP_SERVERS: kafka:9092 GROUP_ID: 1 CONFIG_STORAGE_TOPIC: connect_configs OFFSET_STORAGE_TOPIC: connect_offsets CONNECT_KEY_CONVERTER_SCHEMA_REGISTRY_URL: http://schema-registry:8081 CONNECT_VALUE_CONVERTER_SCHEMA_REGISTRY_URL: http://schema-registry:8081
depends_on: [kafka] ports:
8083:8083
schema-registry: image: confluentinc/cp-schema-registry:7.5.1 environment:
SCHEMA_REGISTRY_KAFKASTORE_SECURITY_PROTOCOL=PLAINTEXT
ports: