confluentinc / examples

Apache Kafka and Confluent Platform examples and demos
Apache License 2.0
1.92k stars 1.12k forks source link

docker-compose_kafka-connect-cp does not start ? #334

Open anandkumarkj opened 5 years ago

anandkumarkj commented 5 years ago

d postgres-debezium-ksql-elasticsearch/ cd docker-compose After docker-compose -up -d $ docker-compose ps

      Name                             Command               State                           Ports                        

docker-compose_connect-debezium_1 /docker-entrypoint.sh start Up 0.0.0.0:8083->8083/tcp, 8778/tcp, 9092/tcp, 9779/tcp docker-compose_datagen-ratings_1 bash -c echo Waiting for K ... Up docker-compose_kafka-connect-cp_1 /etc/confluent/docker/run Exit 1 docker-compose_kafka_1 /etc/confluent/docker/run Up 0.0.0.0:9092->9092/tcp docker-compose_ksql-cli_1 /bin/sh Up docker-compose_ksql-server_1 /etc/confluent/docker/run Up 8088/tcp docker-compose_postgres_1 docker-entrypoint.sh postgres Up 5432/tcp docker-compose_schema-registry_1 /etc/confluent/docker/run Up 0.0.0.0:8081->8081/tcp docker-compose_zookeeper_1 /etc/confluent/docker/run Up 2181/tcp, 2888/tcp, 3888/tcp elasticsearch /usr/local/bin/docker-entr ... Up 0.0.0.0:9200->9200/tcp, 0.0.0.0:9300->9300/tcp kibana /usr/local/bin/kibana-docker Up 0.0.0.0:5601->5601/tcp

""""" docker-compose_kafka-connect-cp_1 /etc/confluent/docker/run Exit 1 . """"""""" it would be nice if we have such issues corrected, so as newbies like us can easily pick up from these examples..

anandkumarkj commented 5 years ago

CONNECT will error out on the next step.. Unable to run the samples excerise for postgres-cdc-ksql

$ scripts/setup.sh HTTP/1.1 100 Continue

HTTP/1.1 201 Created Date: Thu, 07 Nov 2019 21:48:58 GMT Location: http://connect-debezium:8083/connectors/pg-source Content-Type: application/json Content-Length: 943 Server: Jetty(9.2.24.v20180105)

{"name":"pg-source","config":{"connector.class":"io.debezium.connector.postgresql.PostgresConnector","tasks.max":"1","database.hostname":"postgres","database.port":"5432","database.user":"postgres","database.password":"postgres","database.dbname":"postgres","database.server.name":"asgard","database.history.kafka.bootstrap.servers":"kafka:29092","database.history.kafka.topic":"schema-changes.pg","transforms":"unwrap,InsertTopic,InsertSourceDetails","transforms.unwrap.type":"io.debezium.transforms.UnwrapFromEnvelope","transforms.InsertTopic.type":"org.apache.kafka.connect.transforms.InsertField$Value","transforms.InsertTopic.topic.field":"messagetopic","transforms.InsertSourceDetails.type":"org.apache.kafka.connect.transforms.InsertField$Value","transforms.InsertSourceDetails.static.field":"messagesource","transforms.InsertSourceDetails.static.value":"Debezium CDC from Postgres on asgard","name":"pg-source"},"tasks":[],"type":null}ERROR: No container found for kafka-connect-cp_1 {"acknowledged":true}ERROR: No container found for kafka-connect-cp_1 {"_index":"ratings-with-customer-data","_type":"type.name=kafkaconnect","_id":"obLXR24BECofypaulsC9","_version":1,"result":"created","_shards":{"total":1,"successful":1,"failed":0},"_seq_no":0,"_primary_term":1}{"_index":"unhappy_platinum_customers","_type":"type.name=kafkaconnect","_id":"orLXR24BECofypaul8Bu","_version":1,"result":"created","_shards":{"total":1,"successful":1,"failed":0},"_seq_no":0,"_primary_term":1}{"id":"69155280-01a8-11ea-b350-7d5f5b12871e","type":"index-pattern","updated_at":"2019-11-07T21:49:01.736Z","version":1,"attributes":{"title":"ratings-with-customer-data","timeFieldName":"EXTRACT_TS"}}{"id":"69bf7530-01a8-11ea-b350-7d5f5b12871e","type":"index-pattern","updated_at":"2019-11-07T21:49:02.851Z","version":1,"attributes":{"title":"unhappy_platinum_customers","timeFieldName":"EXTRACT_TS"}}OXC02ZC3Z9LVDQ:docker-compose $

ybyzek commented 5 years ago

@anandkumarkj I just pushed a fix https://github.com/confluentinc/examples/commit/6397e9b0564a44bd9755049d836f701bc41888a6 . Can you please do a fresh pull and try again?

janumpallykalyan commented 5 years ago

docker-compose_connect-debezium_1 /docker-entrypoint.sh start Exit 1
docker-compose_datagen-ratings_1 bash -c echo Waiting for K ... Exit 1
docker-compose_elasticsearch_1 /usr/local/bin/docker-entr ... Up 0.0.0.0:9200->9200/tcp, 9300/tcp
docker-compose_kafka-connect-cp_1 /etc/confluent/docker/run Up (health: starting) 0.0.0.0:18083->18083/tcp, 8083/tcp, 9092/tcp docker-compose_kafka_1 /etc/confluent/docker/run Up 0.0.0.0:9092->9092/tcp
docker-compose_ksql-cli_1 /bin/sh Up
docker-compose_ksql-server_1 /etc/confluent/docker/run Up 8088/tcp
docker-compose_postgres_1 docker-entrypoint.sh postgres Up 5432/tcp
docker-compose_schema-registry_1 /etc/confluent/docker/run Exit 1
docker-compose_zookeeper_1 /etc/confluent/docker/run Up 2181/tcp, 2888/tcp, 3888/tcp
kibana /usr/local/bin/kibana-docker Up 0.0.0.0:5601->5601/tcp

I also have same issue. It still not working. It is up but . says Up (health: starting)

ybyzek commented 5 years ago

@janumpallykalyan can you please confirm you did a fresh pull on 5.3.1-post and that it has the fix 6397e9b ?

$ git log | grep  6397e9b
commit 6397e9b0564a44bd9755049d836f701bc41888a6
janumpallykalyan commented 5 years ago

Yes. I have done fresh pull.

ybyzek commented 5 years ago

@janumpallykalyan can you please elaborate on "It still not working"? Search the connect logs and copy/paste the error message