search

confluentinc / confluent-kafka-go

Confluent's Apache Kafka Golang client
Apache License 2.0
4.65k stars 659 forks source link

Generated Errors #273

Closed liquidninja07 closed 5 years ago

liquidninja07 commented 5 years ago

Description

Cannot use kafka lib without running into errors from current commit.

How to reproduce

go get -u github.com/confluentinc/confluent-kafka-go/kafka

Checklist

Please provide the following information:

Debug

kafka/generated_errors.go:258:65: could not determine kind of name for C.RD_KAFKA_RESP_ERR_DELEGATION_TOKEN_AUTHORIZATION_FAILED kafka/generated_errors.go:250:58: could not determine kind of name for C.RD_KAFKA_RESP_ERR_DELEGATION_TOKEN_AUTH_DISABLED kafka/generated_errors.go:260:53: could not determine kind of name for C.RD_KAFKA_RESP_ERR_DELEGATION_TOKEN_EXPIRED kafka/generated_errors.go:252:54: could not determine kind of name for C.RD_KAFKA_RESP_ERR_DELEGATION_TOKEN_NOT_FOUND kafka/generated_errors.go:254:59: could not determine kind of name for C.RD_KAFKA_RESP_ERR_DELEGATION_TOKEN_OWNER_MISMATCH kafka/generated_errors.go:256:63: could not determine kind of name for C.RD_KAFKA_RESP_ERR_DELEGATION_TOKEN_REQUEST_NOT_ALLOWED kafka/generated_errors.go:268:53: could not determine kind of name for C.RD_KAFKA_RESP_ERR_FETCH_SESSION_ID_NOT_FOUND kafka/generated_errors.go:266:46: could not determine kind of name for C.RD_KAFKA_RESP_ERR_GROUP_ID_NOT_FOUND kafka/generated_errors.go:270:55: could not determine kind of name for C.RD_KAFKA_RESP_ERR_INVALID_FETCH_SESSION_EPOCH kafka/generated_errors.go:262:51: could not determine kind of name for C.RD_KAFKA_RESP_ERR_INVALID_PRINCIPAL_TYPE kafka/generated_errors.go:240:48: could not determine kind of name for C.RD_KAFKA_RESP_ERR_KAFKA_STORAGE_ERROR kafka/generated_errors.go:272:47: could not determine kind of name for C.RD_KAFKA_RESP_ERR_LISTENER_NOT_FOUND kafka/generated_errors.go:242:45: could not determine kind of name for C.RD_KAFKA_RESP_ERR_LOG_DIR_NOT_FOUND kafka/generated_errors.go:264:44: could not determine kind of name for C.RD_KAFKA_RESP_ERR_NON_EMPTY_GROUP kafka/generated_errors.go:248:53: could not determine kind of name for C.RD_KAFKA_RESP_ERR_REASSIGNMENT_IN_PROGRESS kafka/generated_errors.go:244:55: could not determine kind of name for C.RD_KAFKA_RESP_ERR_SASL_AUTHENTICATION_FAILED kafka/generated_errors.go:274:52: could not determine kind of name for C.RD_KAFKA_RESP_ERR_TOPIC_DELETION_DISABLED kafka/generated_errors.go:246:48: could not determine kind of name for C.RD_KAFKA_RESP_ERR_UNKNOWN_PRODUCER_ID kafka/generated_errors.go:276:57: could not determine kind of name for C.RD_KAFKA_RESP_ERR_UNSUPPORTED_COMPRESSION_TYPE kafka/generated_errors.go:118:36: could not determine kind of name for C.RD_KAFKA_RESP_ERRFATAL kafka/generated_errors.go:122:47: could not determine kind of name for C.RD_KAFKA_RESP_ERRGAPLESS_GUARANTEE kafka/generated_errors.go:120:43: could not determine kind of name for C.RD_KAFKA_RESP_ERRINCONSISTENT kafka/generated_errors.go:124:46: could not determine kind of name for C.RD_KAFKA_RESP_ERRMAX_POLL_EXCEEDED kafka/generated_errors.go:116:44: could not determine kind of name for C.RD_KAFKA_RESP_ERRPURGE_INFLIGHT kafka/generated_errors.go:114:41: could not determine kind of name for C.RD_KAFKA_RESP_ERR__PURGE_QUEUE kafka/generated_errors.go:112:36: could not determine kind of name for C.RD_KAFKA_RESP_ERRRETRY

edenhill commented 5 years ago

You should pin in at the latest version: v0.11.6. Starting with the next version v1.0.0 (release due within a month), we'll keep the master branch pinned to the latest version. Sorry for the inconvenience.

edenhill commented 5 years ago

Alternatively, you can install librdkafka by source from its master branch, but that should only be used for development work (and allow you to try out the idempotent producer!)

pragmaticpi commented 5 years ago

I am getting the above errors despite using librdkafka v0.11.6. I am using brew to install.

While trying building from source, I am getting following error on MacOS Mojave 10.14.3

install: mkdir /usr/include: Operation not permitted make[1]: [lib-install] Error 71 make: [install] Error 2

edenhill commented 5 years ago

On osx you might need to install librdkafka to /usr/local (which is the default), so basically:

$ cd librdkafka
$ ./configure --prefix=/usr/local # or just ./configure
$ make
$ sudo make install
kjm789 commented 5 years ago

After building librdkafka from source at the location /usr/local, I can confirm that the issue illustrated by this ticket that I was seeing on my local macbook (version 10.13.6 High Sierra) was resolved.

It should be noted that I also initially installed librdkafka with homebrew and I was too seeing this issue illustrated by this ticket.

daniesy commented 5 years ago

On osx you might need to install librdkafka to /usr/local (which is the default), so basically:

$ cd librdkafka
$ ./configure --prefix=/usr/local # or just ./configure
$ make
$ sudo make install

Tried to remove librdkafka from brew and install it manually and still isn't working on Mojave 10.14.3.

edenhill commented 5 years ago

@daniesy Can you provide the output from the librdkafka installation as well as the Go client build?

daniesy commented 5 years ago

@edenhill i forgot the local from --prefix=/usr/local and got mkdir /usr/include: Operation not permitted.

Fixed it. Thanks.

freeformz commented 5 years ago

FWIW: The kafka/generated_errors.go file was generated off of librdkafka 1.0.0-RC5-20-ga66502-devel-O0. When I regenerated it using go_rdkafka_generr/go_rdkafka_generr.go against librdkafka 0.11.6 installed via homebrew I was able to install confluent-kafka-go without a problem.

edsonmedina commented 5 years ago

I'm having the same issue with librdkafka 0.11.6 in alpine 3.8.

kumarh1982 commented 5 years ago

same here, getting following errors in while running docker image with confluent kafka subscriber app.

vendor/github.com/confluentinc/confluent-kafka-go/kafka/generated_errors.go:258:65: could not determine kind of name for C.RD_KAFKA_RESP_ERR_DELEGATION_TOKEN_AUTHORIZATION_FAILED vendor/github.com/confluentinc/confluent-kafka-go/kafka/generated_errors.go:250:58: could not determine kind of name for C.RD_KAFKA_RESP_ERR_DELEGATION_TOKEN_AUTH_DISABLED vendor/github.com/confluentinc/confluent-kafka-go/kafka/generated_errors.go:260:53: could not determine kind of name for C.RD_KAFKA_RESP_ERR_DELEGATION_TOKEN_EXPIRED

and so on..

vijaygurunanee commented 5 years ago

I am getting same error on windows environment... windows-7 operating system... :( I have librdkafka.redist.0.11.6 (already updated) and i have proper rdkafka.pc....

github.com/confluentinc/confluent-kafka-go/kafka

could not determine kind of name for C.RD_KAFKA_RESP_ERR_DELEGATION_TOKEN_AUTHORIZATION_FAILED could not determine kind of name for C.RD_KAFKA_RESP_ERR_DELEGATION_TOKEN_AUTH_DISABLED could not determine kind of name for C.RD_KAFKA_RESP_ERR_DELEGATION_TOKEN_EXPIRED could not determine kind of name for C.RD_KAFKA_RESP_ERR_DELEGATION_TOKEN_NOT_FOUND could not determine kind of name for C.RD_KAFKA_RESP_ERR_DELEGATION_TOKEN_OWNER_MISMATCH could not determine kind of name for C.RD_KAFKA_RESP_ERR_DELEGATION_TOKEN_REQUEST_NOT_ALLOWED could not determine kind of name for C.RD_KAFKA_RESP_ERR_FETCH_SESSION_ID_NOT_FOUND could not determine kind of name for C.RD_KAFKA_RESP_ERR_GROUP_ID_NOT_FOUND could not determine kind of name for C.RD_KAFKA_RESP_ERR_INVALID_FETCH_SESSION_EPOCH could not determine kind of name for C.RD_KAFKA_RESP_ERR_INVALID_PRINCIPAL_TYPE could not determine kind of name for C.RD_KAFKA_RESP_ERR_KAFKA_STORAGE_ERROR could not determine kind of name for C.RD_KAFKA_RESP_ERR_LISTENER_NOT_FOUND could not determine kind of name for C.RD_KAFKA_RESP_ERR_LOG_DIR_NOT_FOUND could not determine kind of name for C.RD_KAFKA_RESP_ERR_NON_EMPTY_GROUP could not determine kind of name for C.RD_KAFKA_RESP_ERR_REASSIGNMENT_IN_PROGRESS could not determine kind of name for C.RD_KAFKA_RESP_ERR_SASL_AUTHENTICATION_FAILED could not determine kind of name for C.RD_KAFKA_RESP_ERR_TOPIC_DELETION_DISABLED could not determine kind of name for C.RD_KAFKA_RESP_ERR_UNKNOWN_PRODUCER_ID could not determine kind of name for C.RD_KAFKA_RESP_ERR_UNSUPPORTED_COMPRESSION_TYPE could not determine kind of name for C.RD_KAFKA_RESP_ERRFATAL could not determine kind of name for C.RD_KAFKA_RESP_ERRGAPLESS_GUARANTEE could not determine kind of name for C.RD_KAFKA_RESP_ERRINCONSISTENT could not determine kind of name for C.RD_KAFKA_RESP_ERRMAX_POLL_EXCEEDED could not determine kind of name for C.RD_KAFKA_RESP_ERRPURGE_INFLIGHT could not determine kind of name for C.RD_KAFKA_RESP_ERRPURGE_QUEUE could not determine kind of name for C.RD_KAFKA_RESP_ERR__RETRY

isapir commented 5 years ago

Getting the same on Ubuntu 18.04 with librdkafka-dev 0.11.6

liquidninja07 commented 5 years ago

I am closing this issue that I opened. I have manually installed librdkafka and updated confluent kafka to the current version. Tested and verified it works on macos, centos, and ubuntu.