search

travisjeffery / jocko

Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)
https://twitter.com/travisjeffery
MIT License
4.93k stars 362 forks source link

Various errors when testing with kafkacat #37

Open neelance opened 7 years ago

neelance commented 7 years ago

This is what I did:

I am sometimes able to send messages, but it is crashing on me with various errors:

% Reached end of topic logs [0] at offset 2
% ERROR: Topic logs [0] error: Message at offset 2 is too large to fetch, try increasing receive.message.max.bytes
%3|1490267581.359|FAIL|rdkafka#consumer-1| [thrd:127.0.0.1:9092/bootstrap]: 127.0.0.1:9092/bootstrap: Receive failed: Disconnected
%5|1490267581.359|FAIL|rdkafka#consumer-1| [thrd:127.0.0.1:9092/bootstrap]: 127.0.0.1:9092/bootstrap: Connection closed
% ERROR: Local: Broker transport failure: 127.0.0.1:9092/bootstrap: Receive failed: Disconnected
% ERROR: Local: Broker transport failure: 127.0.0.1:9092/bootstrap: Connection closed

and similar.

c0ze commented 7 years ago

I'm doing a similar test, I'm not getting any errors but lots of debug messages like this :

2017-03-30 16:02:20 [DEBUG] jocko: correlation id [23], request size [26], key [3]
2017-03-30 16:02:21 [DEBUG] jocko: correlation id [24], request size [26], key [3]
2017-03-30 16:02:22 [DEBUG] jocko: correlation id [25], request size [26], key [3]
2017-03-30 16:02:23 [DEBUG] jocko: correlation id [26], request size [26], key [3]
2017-03-30 16:02:24 [DEBUG] jocko: correlation id [27], request size [26], key [3]

And I don't get any messages on the consumer. Can we have a simple working getting started tutorial ?

VShell commented 7 years ago

I'm suffering exactly these errors on latest master, as well as various issues with another (sarama based) client. I've been entirely unable to get anything except examples/sarama/main.go working.

mrcrgl commented 7 years ago

This is because kafkacat is asking for APIVersions (key:18) which is not implemented at the time.

See: https://github.com/travisjeffery/jocko/blob/master/server/server.go#L139

gertcuykens commented 6 years ago

kafkacat -C -b 127.0.0.1:9092 -t test_topic

%3|1509902328.974|PROTOERR|rdkafka#consumer-1| [thrd:127.0.0.1:9092/bootstrap]: 127.0.0.1:9092/1: Remaining data after message set parse: 164 bytes
%3|1509902329.076|PROTOERR|rdkafka#consumer-1| [thrd:127.0.0.1:9092/bootstrap]: 127.0.0.1:9092/1: Protocol parse failure at 4/168 (rd_kafka_fetch_reply_handle:2749) (incorrect broker.version.fallback?)