search

confluentinc / bottledwater-pg

Change data capture from PostgreSQL into Kafka
http://blog.confluent.io/2015/04/23/bottled-water-real-time-integration-of-postgresql-and-kafka/
Apache License 2.0
3 stars 149 forks source link

Cannot start docker-compose up -d bottledwater-avro #127

Open imanzano opened 7 years ago

imanzano commented 7 years ago

I follow every step of the docker running , but when I run "docker-compose up -d bottledwater-avro" it finished with the following error

/usr/local/bin/bottledwater-docker-wrapper.sh: Setting option --allow-unkeyed /usr/local/bin/bottledwater-docker-wrapper.sh: Setting option --output-format=avro /usr/local/bin/bottledwater-docker-wrapper.sh: Detected schema registry, setting --schema-registry=http://schema-registry:8081 /usr/local/bin/bottledwater-docker-wrapper.sh: Running: /usr/local/bin/bottledwater --postgres=host=postgres port=5432 dbname=postgres user=postgres --broker=kafka:9092 --allow-unkeyed --output-format=avro --schema-registry=http://schema-registry:8081 --topic-config=message.timeout.ms=2000 [INFO] Writing messages to Kafka in Avro format [INFO] Created replication slot "bottledwater", capturing consistent snapshot "000002AD-1". [FATAL] While reading snapshot: PGRES_FATAL_ERROR: ERROR: function bottledwater_export(table_pattern := text, allow_unkeyed := boolean, error_policy := text) does not exist LINE 1: SELECT bottledwater_export(table_pattern := $1, allow_unkeye... ^ HINT: No function matches the given name and argument types. You might need to add explicit type casts.

[INFO] Dropping replication slot since the snapshot did not complete successfully.

amitdev commented 7 years ago

@imanzano did you create the extension (create extension bottledwater;) in the same database (dbname: postgres)? The error seems to be because the extension is missing.

mbelarbi commented 7 years ago

@amitdev That's not necessarily true. I have the same issue (albeit I'm not running via docker). I run a \dx (list all extensions installed) on the postgres database. The extension is definitely installed and i'm still getting this annoying issue.

I don't know why and I don't have a solution.

wswuai commented 7 years ago

i hit this issue .

when i run docker ps -a

i got

adf3c7bd0fcc bottledwaterpg_bottledwater-avro "/usr/local/bin/bo..." 4 minutes ago Exited (1) 4 minutes ago bottledwaterpg_bottledwater-avro_1 707a28279450 confluent/schema-registry:2.0.1 "/usr/local/bin/sc..." 13 minutes ago Up 13 minutes 0.0.0.0:48081->8081/tcp bottledwaterpg_schema-registry_1 21d7569813ac confluent/kafka:0.9.0.0-cp1 "/usr/local/bin/ka..." 13 minutes ago Up 13 minutes 0.0.0.0:9092->9092/tcp bottledwaterpg_kafka_1 c7864916577d bottledwaterpg_postgres-94 "docker-entrypoint..." 13 minutes ago Up 13 minutes 0.0.0.0:54094->5432/tcp bottledwaterpg_postgres-94_1 92fd00a6ff46 bottledwaterpg_postgres "docker-entrypoint..." 14 minutes ago Up 14 minutes 0.0.0.0:54095->5432/tcp bottledwaterpg_postgres_1 3d976d5d426b confluent/zookeeper:3.4.6-cp1 "/usr/local/bin/zk..." 14 minutes ago Up 14 minutes 2888/tcp, 0.0.0.0:2181->2181/tcp, 3888/tcp bottledwaterpg_zookeeper_1

i realized that if bottledwaterpg_postgres-94 may have conflict with bottledwaterpg_postgres ?

so i run

docker stop c7864916577d # which is postgres-94

and i run docker-compose up -d bottledwater-avro successfully.

Hope this will help you. @mbelarbi , may be you have two postgres containers running either.

And I am confused why i have two postgres containers .