search

redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
https://redpanda.com
9.73k stars 591 forks source link

Error while fetching metadata #4925

Open kulame opened 2 years ago

kulame commented 2 years ago

Version & Environment

Redpanda version: (use rpk version): redpanda@96f126e88baf:/$ rpk version v22.1.3 (rev d1a4e00)

What went wrong?

2022-05-25 11:24:42,561 WARN || [Producer clientId=connector-producer-inventory-connector-0] Error while fetching metadata with correlation id 1083 : {npns.public.npns_feed=UNKNOWN_TOPIC_OR_PARTITION} [org.apache.kafka.clients.NetworkClient]

What should have happened instead?

i try to use debezium to sync data follow this document https://redpanda.com/blog/redpanda-debezium/ but i use postgresql.

How to reproduce the issue?

  1. follow the doc https://redpanda.com/blog/redpanda-debezium/

  2. set postgresql connection curl --request POST \ --url http://localhost:8083/connectors \ --header 'Content-Type: application/json' \ --data '{ "name": "inventory-connector", "config": { "connector.class": "io.debezium.connector.postgresql.PostgresConnector", "tasks.max": "1", "database.hostname": "postgres", "database.port": "5432", "database.user": "dbuser",
    "database.password": "dbuser", "database.dbname" : "npns",
    "database.server.name": "npns",
    "table.include.list": "public.npns_feed", "database.history.kafka.bootstrap.servers": "redpanda:9092", "database.history.kafka.topic": "schema-changes.inventory" , "plugin.name": "pgoutput" } }'

  3. check the status sudo docker logs -f common_connect_1

it tell me

2022-05-25 11:28:20,857 WARN || [Producer clientId=connector-producer-inventory-connector-0] Error while fetching metadata with correlation id 3241 : {npns.public.npns_feed=UNKNOWN_TOPIC_OR_PARTITION} [org.apache.kafka.clients.NetworkClient]

Additional information

Please attach any relevant logs, backtraces, or metric charts.

JIRA Link: CORE-925

dotnwat commented 2 years ago

what does rpk topic list show? i walked through the blog post and it seems to be working. so perhaps there is a configuration issue here. seeing the topic list might help illuminate the issue.