search

edenhill / kcat

Generic command line non-JVM Apache Kafka producer and consumer
Other
5.45k stars 484 forks source link

i am getting this error(failed to acquire meta data) and not able to fix it.please help me #181

Open rishavjaiswal opened 5 years ago

rishavjaiswal commented 5 years ago

issue issue2

edenhill commented 5 years ago

try enabling debugging to see what is going on: kafkacat -L -b kafka-1:19092 -d broker

rishavjaiswal commented 5 years ago

i got this...what does it mean and how to get rid of it newissue

edenhill commented 5 years ago

What is your version of kafkacat and librdkafka? kafkacat -V

nit: It'd be good if you could paste the output as text (within backtick quotes for formatting) rather than screenshots.

rishavjaiswal commented 5 years ago

lucky@lucky-Inspiron-N4010:~/kafkacluster$ kafkacat -v Error: -b <broker,..> missing

Usage: kafkacat [file1 file2 ..] kafkacat - Apache Kafka producer and consumer tool https://github.com/edenhill/kafkacat Copyright (c) 2014-2015, Magnus Edenhill Version KAFKACAT_VERSION (JSON) (librdkafka 0.11.1)

rishavjaiswal commented 5 years ago

thats the output

edenhill commented 5 years ago

That looks really old. Upgrade both librdkafka and kafkacat. Easiest way is to remove kafkacat from your system, then download the kafkacat source code and follow the bootstrap instructions: https://github.com/edenhill/kafkacat#quick-build

rishavjaiswal commented 5 years ago

https://github.com/edenhill/kafkacat kafkacat.c is the source code for it?

edenhill commented 5 years ago

https://github.com/edenhill/kafkacat/archive/1.4.0.tar.gz

edenhill commented 5 years ago

Follow the instructions here: https://github.com/edenhill/kafkacat#quick-build

rishavjaiswal commented 5 years ago

after running ./bootstrap.sh whats next?

edenhill commented 5 years ago

if bootstrap.sh succeeds you should have a kafkacat binary in the current directory, try: ./kafkacat -V

rishavjaiswal commented 5 years ago

after running ./bootstrap.sh i got output as : ...... ... .. kafkacat.o format.o tools.o json.o -o kafkacat -L/usr/local/lib -lm -ldl -lpthread -lrt -Wl,-Bstatic -lyajl -Wl,-Bdynamic tmp-bootstrap/usr/local/lib/librdkafka.a -L/usr/local/lib -lm -ldl -lpthread -lrt
/usr/bin/ld: cannot find -lyajl collect2: error: ld returned 1 exit status mklove/Makefile.base:150: recipe for target 'kafkacat' failed make: *** [kafkacat] Error 1

edenhill commented 5 years ago

Then there must have been a previous error as well. Please scan the output of bootstrap.sh for errors and paste them here.

What version of ubuntu are you using?

rishavjaiswal commented 5 years ago

i am using ubuntu 16.04

output of bootstrap.sh is:

lucky@lucky-Inspiron-N4010:~/kafkacluster/kafkacat-1.4.0$ ./bootstrap.sh Directory librdkafka already exists, not downloading https://github.com/edenhill/librdkafka/archive/master.tar.gz Directory libyajl already exists, not downloading https://github.com/lloyd/yajl/archive/master.tar.gz Building librdkafka make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' Checking librdkafka integrity librdkafka.so.1 OK librdkafka.a OK Symbol visibility OK make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' Creating shared library librdkafka++.so.1 gcc -shared -Wl,-soname,librdkafka++.so.1 RdKafka.o ConfImpl.o HandleImpl.o ConsumerImpl.o ProducerImpl.o KafkaConsumerImpl.o TopicImpl.o TopicPartitionImpl.o MessageImpl.o HeadersImpl.o QueueImpl.o MetadataImpl.o -o librdkafka++.so.1 -L../src -lrdkafka -lstdc++ Checking librdkafka++ integrity librdkafka++.so.1 OK librdkafka++.a OK make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' make -C examples make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/examples' make[1]: Nothing to be done for 'all'. make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/examples' Checking integrity CONFIGURATION.md OK examples/rdkafka_example OK examples/rdkafka_performance OK examples/rdkafka_example_cpp OK make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' Checking librdkafka integrity librdkafka.so.1 OK librdkafka.a OK Symbol visibility OK make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' Creating shared library librdkafka++.so.1 gcc -shared -Wl,-soname,librdkafka++.so.1 RdKafka.o ConfImpl.o HandleImpl.o ConsumerImpl.o ProducerImpl.o KafkaConsumerImpl.o TopicImpl.o TopicPartitionImpl.o MessageImpl.o HeadersImpl.o QueueImpl.o MetadataImpl.o -o librdkafka++.so.1 -L../src -lrdkafka -lstdc++ Checking librdkafka++ integrity librdkafka++.so.1 OK librdkafka++.a OK make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' Install librdkafka to /home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap//usr/local install -d $DESTDIR/usr/local/include/librdkafka && \ install -d $DESTDIR/usr/local/lib && \ install rdkafka.h $DESTDIR/usr/local/include/librdkafka && \ install librdkafka.a $DESTDIR/usr/local/lib && \ install librdkafka.so.1 $DESTDIR/usr/local/lib && \ [ -f "rdkafka.pc" ] && ( \ install -d $DESTDIR/usr/local/lib/pkgconfig && \ install -m 0644 rdkafka.pc $DESTDIR/usr/local/lib/pkgconfig \ ) && \ [ -f "rdkafka-static.pc" ] && ( \ install -d $DESTDIR/usr/local/lib/pkgconfig && \ install -m 0644 rdkafka-static.pc $DESTDIR/usr/local/lib/pkgconfig \ ) && \ (cd $DESTDIR/usr/local/lib && ln -sf librdkafka.so.1 librdkafka.so) make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' Install librdkafka++ to /home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap//usr/local install -d $DESTDIR/usr/local/include/librdkafka && \ install -d $DESTDIR/usr/local/lib && \ install rdkafkacpp.h $DESTDIR/usr/local/include/librdkafka && \ install librdkafka++.a $DESTDIR/usr/local/lib && \ install librdkafka++.so.1 $DESTDIR/usr/local/lib && \ [ -f "rdkafka++.pc" ] && ( \ install -d $DESTDIR/usr/local/lib/pkgconfig && \ install -m 0644 rdkafka++.pc $DESTDIR/usr/local/lib/pkgconfig \ ) && \ [ -f "rdkafka++-static.pc" ] && ( \ install -d $DESTDIR/usr/local/lib/pkgconfig && \ install -m 0644 rdkafka++-static.pc $DESTDIR/usr/local/lib/pkgconfig \ ) && \ (cd $DESTDIR/usr/local/lib && ln -sf librdkafka++.so.1 librdkafka++.so) make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' Build of librdkafka SUCCEEDED! Building libyajl == removing old build files == running CMake in build directory ./configure: 41: ./configure: cmake: not found The "cmake" program is required to configure yajl. It's available from most ports/packaging systems and http://cmake.org Build of libyajl FAILED! Failed to build libyajl: JSON support will probably be disabled Building kafkacat Using -L/usr/local/lib -lm -ldl -lpthread -lrt for rdkafka Using for yajl using cache file config.cache checking for OS or distribution... ok (Ubuntu) checking for C compiler from CC env... failed checking for gcc (by command)... ok (cached) checking executable ld... ok (cached) checking executable nm... ok (cached) checking executable objdump... ok (cached) checking executable strip... ok (cached) checking for pkgconfig (by command)... ok (cached) checking for install (by command)... ok (cached) checking for rdkafka (by pkg-config)... ok checking for rdkafka (by compile)... ok (cached) checking for librdkafka metadata API... ok (cached) checking for librdkafka KafkaConsumer support... ok (cached) checking for yajl (by pkg-config)... ok checking for yajl (by compile)... ok (cached) Generated Makefile.config Generated config.h

Configuration summary: prefix /usr/local ARCH x86_64 CPU generic MKL_APP_NAME
MKL_APP_DESC_ONELINE
MKL_DISTRO Ubuntu SOLIB_EXT .so CC gcc LD ld NM nm OBJDUMP objdump STRIP strip CPPFLAGS -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align PKG_CONFIG pkg-config INSTALL install LDFLAGS_STATIC -Wl,-Bstatic LDFLAGS_DYNAMIC -Wl,-Bdynamic HAS_LDFLAGS_STATIC y KAFKACAT_VERSION 1.4.0 CFLAGS -I/usr/include/yajl LIBS -Wl,-Bstatic -lyajl -Wl,-Bdynamic tmp-bootstrap/usr/local/lib/librdkafka.a -L/usr/local/lib -lm -ldl -lpthread -lrt
ENABLE_KAFKACONSUMER y ENABLE_JSON y exec_prefix /usr/local bindir /usr/local/bin sbindir /usr/local/sbin libexecdir /usr/local/libexec datadir /usr/local/share sysconfdir /usr/local/etc sharedstatedir /usr/local/com localstatedir /usr/local/var libdir /usr/local/lib includedir /usr/local/include infodir /usr/local/info mandir /usr/local/man Generated config.cache

Now type 'make' to build gcc -MD -MP -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -I/usr/include/yajl -c kafkacat.c -o kafkacat.o mgcc -MD -MP -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -I/usr/include/yajl -c format.c -o format.o gcc -MD -MP -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -I/usr/include/yajl -c tools.c -o tools.o akegcc -MD -MP -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -I/usr/include/yajl -c json.c -o json.o Creating program kafkacat gcc -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align kafkacat.o format.o tools.o json.o -o kafkacat -L/usr/local/lib -lm -ldl -lpthread -lrt -Wl,-Bstatic -lyajl -Wl,-Bdynamic tmp-bootstrap/usr/local/lib/librdkafka.a -L/usr/local/lib -lm -ldl -lpthread -lrt
/usr/bin/ld: cannot find -lyajl collect2: error: ld returned 1 exit status mklove/Makefile.base:150: recipe for target 'kafkacat' failed make: *** [kafkacat] Error 1 lucky@lucky-Inspiron-N4010:~/kafkacluster/kafkacat-1.4.0$ ./bootstrap.sh Directory librdkafka already exists, not downloading https://github.com/edenhill/librdkafka/archive/master.tar.gz Directory libyajl already exists, not downloading https://github.com/lloyd/yajl/archive/master.tar.gz Building librdkafka make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' Checking librdkafka integrity librdkafka.so.1 OK librdkafka.a OK Symbol visibility OK make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' Creating shared library librdkafka++.so.1 gcc -shared -Wl,-soname,librdkafka++.so.1 RdKafka.o ConfImpl.o HandleImpl.o ConsumerImpl.o ProducerImpl.o KafkaConsumerImpl.o TopicImpl.o TopicPartitionImpl.o MessageImpl.o HeadersImpl.o QueueImpl.o MetadataImpl.o -o librdkafka++.so.1 -L../src -lrdkafka -lstdc++ Checking librdkafka++ integrity librdkafka++.so.1 OK librdkafka++.a OK make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' make -C examples make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/examples' make[1]: Nothing to be done for 'all'. make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/examples' Checking integrity CONFIGURATION.md OK examples/rdkafka_example OK examples/rdkafka_performance OK examples/rdkafka_example_cpp OK make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' Checking librdkafka integrity librdkafka.so.1 OK librdkafka.a OK Symbol visibility OK make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' Creating shared library librdkafka++.so.1 gcc -shared -Wl,-soname,librdkafka++.so.1 RdKafka.o ConfImpl.o HandleImpl.o ConsumerImpl.o ProducerImpl.o KafkaConsumerImpl.o TopicImpl.o TopicPartitionImpl.o MessageImpl.o HeadersImpl.o QueueImpl.o MetadataImpl.o -o librdkafka++.so.1 -L../src -lrdkafka -lstdc++ Checking librdkafka++ integrity librdkafka++.so.1 OK librdkafka++.a OK make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' Install librdkafka to /home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap//usr/local install -d $DESTDIR/usr/local/include/librdkafka && \ install -d $DESTDIR/usr/local/lib && \ install rdkafka.h $DESTDIR/usr/local/include/librdkafka && \ install librdkafka.a $DESTDIR/usr/local/lib && \ install librdkafka.so.1 $DESTDIR/usr/local/lib && \ [ -f "rdkafka.pc" ] && ( \ install -d $DESTDIR/usr/local/lib/pkgconfig && \ install -m 0644 rdkafka.pc $DESTDIR/usr/local/lib/pkgconfig \ ) && \ [ -f "rdkafka-static.pc" ] && ( \ install -d $DESTDIR/usr/local/lib/pkgconfig && \ install -m 0644 rdkafka-static.pc $DESTDIR/usr/local/lib/pkgconfig \ ) && \ (cd $DESTDIR/usr/local/lib && ln -sf librdkafka.so.1 librdkafka.so) make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' Install librdkafka++ to /home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap//usr/local install -d $DESTDIR/usr/local/include/librdkafka && \ install -d $DESTDIR/usr/local/lib && \ install rdkafkacpp.h $DESTDIR/usr/local/include/librdkafka && \ install librdkafka++.a $DESTDIR/usr/local/lib && \ install librdkafka++.so.1 $DESTDIR/usr/local/lib && \ [ -f "rdkafka++.pc" ] && ( \ install -d $DESTDIR/usr/local/lib/pkgconfig && \ install -m 0644 rdkafka++.pc $DESTDIR/usr/local/lib/pkgconfig \ ) && \ [ -f "rdkafka++-static.pc" ] && ( \ install -d $DESTDIR/usr/local/lib/pkgconfig && \ install -m 0644 rdkafka++-static.pc $DESTDIR/usr/local/lib/pkgconfig \ ) && \ (cd $DESTDIR/usr/local/lib && ln -sf librdkafka++.so.1 librdkafka++.so) make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' Build of librdkafka SUCCEEDED! Building libyajl == removing old build files == running CMake in build directory ./configure: 41: ./configure: cmake: not found The "cmake" program is required to configure yajl. It's available from most ports/packaging systems and http://cmake.org Build of libyajl FAILED! Failed to build libyajl: JSON support will probably be disabled Building kafkacat Using -L/usr/local/lib -lm -ldl -lpthread -lrt for rdkafka Using for yajl using cache file config.cache checking for OS or distribution... ok (Ubuntu) checking for C compiler from CC env... failed checking for gcc (by command)... ok (cached) checking executable ld... ok (cached) checking executable nm... ok (cached) checking executable objdump... ok (cached) checking executable strip... ok (cached) checking for pkgconfig (by command)... ok (cached) checking for install (by command)... ok (cached) checking for rdkafka (by pkg-config)... ok checking for rdkafka (by compile)... ok (cached) checking for librdkafka metadata API... ok (cached) checking for librdkafka KafkaConsumer support... ok (cached) checking for yajl (by pkg-config)... ok checking for yajl (by compile)... ok (cached) Generated Makefile.config Generated config.h

Configuration summary: prefix /usr/local ARCH x86_64 CPU generic MKL_APP_NAME
MKL_APP_DESC_ONELINE
MKL_DISTRO Ubuntu SOLIB_EXT .so CC gcc LD ld NM nm OBJDUMP objdump STRIP strip CPPFLAGS -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align PKG_CONFIG pkg-config INSTALL install LDFLAGS_STATIC -Wl,-Bstatic LDFLAGS_DYNAMIC -Wl,-Bdynamic HAS_LDFLAGS_STATIC y KAFKACAT_VERSION 1.4.0 CFLAGS -I/usr/include/yajl LIBS -Wl,-Bstatic -lyajl -Wl,-Bdynamic tmp-bootstrap/usr/local/lib/librdkafka.a -L/usr/local/lib -lm -ldl -lpthread -lrt
ENABLE_KAFKACONSUMER y ENABLE_JSON y exec_prefix /usr/local bindir /usr/local/bin sbindir /usr/local/sbin libexecdir /usr/local/libexec datadir /usr/local/share sysconfdir /usr/local/etc sharedstatedir /usr/local/com localstatedir /usr/local/var libdir /usr/local/lib includedir /usr/local/include infodir /usr/local/info mandir /usr/local/man Generated config.cache

Now type 'make' to build gcc -MD -MP -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -I/usr/include/yajl -c kafkacat.c -o kafkacat.o gcc -MD -MP -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -I/usr/include/yajl -c format.c -o format.o gcc -MD -MP -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -I/usr/include/yajl -c tools.c -o tools.o gcc -MD -MP -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -I/usr/include/yajl -c json.c -o json.o Creating program kafkacat gcc -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align kafkacat.o format.o tools.o json.o -o kafkacat -L/usr/local/lib -lm -ldl -lpthread -lrt -Wl,-Bstatic -lyajl -Wl,-Bdynamic tmp-bootstrap/usr/local/lib/librdkafka.a -L/usr/local/lib -lm -ldl -lpthread -lrt
/usr/bin/ld: cannot find -lyajl collect2: error: ld returned 1 exit status mklove/Makefile.base:150: recipe for target 'kafkacat' failed make: *** [kafkacat] Error 1

edenhill commented 5 years ago

./configure: 41: ./configure: cmake: not found

You need to install cmake (sudo apt install cmake). Please follow the instructions previously given.

rishavjaiswal commented 5 years ago

./kafkacat -V ran succesfully.

output is kafkacat - Apache Kafka producer and consumer tool https://github.com/edenhill/kafkacat Copyright (c) 2014-2017, Magnus Edenhill Version 1.4.0 (JSON) (librdkafka 1.0.0 builtin.features=snappy,sasl,regex,lz4,sasl_plain,plugins)

rishavjaiswal commented 5 years ago

after runnung kafkacat -L -b kafka-1:19092 -d broker i got this:-

%7|1558461714.621|BRKMAIN|rdkafka#producer-1| [thrd::0/internal]: :0/internal: Enter main broker thread %7|1558461714.621|BROKER|rdkafka#producer-1| [thrd:app]: kafka-1:19092/bootstrap: Added new broker with NodeId -1 %7|1558461714.621|STATE|rdkafka#producer-1| [thrd::0/internal]: :0/internal: Broker changed state INIT -> UP %7|1558461714.621|BRKMAIN|rdkafka#producer-1| [thrd:kafka-1:19092/bootstrap]: kafka-1:19092/bootstrap: Enter main broker thread %7|1558461714.621|CONNECT|rdkafka#producer-1| [thrd:kafka-1:19092/bootstrap]: kafka-1:19092/bootstrap: broker in state INIT connecting %7|1558461714.622|CONNECT|rdkafka#producer-1| [thrd:kafka-1:19092/bootstrap]: kafka-1:19092/bootstrap: Connecting to ipv4#192.168.1.231:19092 (plaintext) with socket 7 %7|1558461714.622|STATE|rdkafka#producer-1| [thrd:kafka-1:19092/bootstrap]: kafka-1:19092/bootstrap: Broker changed state INIT -> CONNECT % ERROR: Failed to acquire metadata: Local: Broker transport failure

edenhill commented 5 years ago

Seems like it is not able to connect to the broker in due time (5s). Can you connect to the broker with telnet kafka-1 9092 ?

rishavjaiswal commented 5 years ago

after trying with telnet

Trying 192.168.1.231... telnet: Unable to connect to remote host: Connection timed out

rishavjaiswal commented 5 years ago

./kafkacat -V says this version: kafkacat - Apache Kafka producer and consumer tool https://github.com/edenhill/kafkacat Copyright (c) 2014-2017, Magnus Edenhill Version 1.4.0 (JSON) (librdkafka 1.0.0 builtin.features=snappy,sasl,regex,lz4,sasl_plain,plugins)

whereas when i am running kafkacat -V its showing : kafkacat: invalid option -- 'V' Error: unknown argument

Usage: kafkacat [file1 file2 ..] kafkacat - Apache Kafka producer and consumer tool https://github.com/edenhill/kafkacat Copyright (c) 2014-2015, Magnus Edenhill Version KAFKACAT_VERSION (JSON) (librdkafka 0.11.1)

edenhill commented 5 years ago 
Trying 192.168.1.231...
telnet: Unable to connect to remote host: Connection timed out

So that's your problem, your broker can't be reached, for whatever reason: no route to broker, broker host being down, firewall/filtering, etc.

rishavjaiswal commented 5 years ago

i stopped firewall but i am still not getting please tell me what to do

edenhill commented 5 years ago

I'm sorry but it is impossible for me to troubleshoot your networking / cluster / infra problems. Please reach out to your operations team.