elodina / scala-kafka

Quick up and running using Scala for Apache Kafka
Apache License 2.0
331 stars 135 forks source link

undefined reference to 'OPENSSL_add_all_algorithms_noconf' #37

Closed prayagupa closed 8 years ago

prayagupa commented 8 years ago

Can't vagrant up. I get following error

==> zookeeper: rd_kafka_ssl_error
==> zookeeper: '
==> zookeeper: :
==> zookeeper: /
==> zookeeper: opt
==> zookeeper: /
==> zookeeper: github
==> zookeeper: /
==> zookeeper: edenhill
==> zookeeper: /
==> zookeeper: kafkacat
==> zookeeper: /
==> zookeeper: tmp
==> zookeeper: -
==> zookeeper: bootstrap
==> zookeeper: /
==> zookeeper: librdkafka
==> zookeeper: /
==> zookeeper: src
==> zookeeper: /
==> zookeeper: rdkafka_transport.c
==> zookeeper: :
==> zookeeper: 289
==> zookeeper: :
==> zookeeper:  
==> zookeeper: undefined
==> zookeeper:  
==> zookeeper: reference
==> zookeeper:  
==> zookeeper: to
==> zookeeper:  
==> zookeeper: `
==> zookeeper: ERR_error_string_n
==> zookeeper: '
==> zookeeper: /
==> zookeeper: opt
==> zookeeper: /
==> zookeeper: github
==> zookeeper: /
==> zookeeper: edenhill
==> zookeeper: /
==> zookeeper: kafkacat
==> zookeeper: /
==> zookeeper: tmp
==> zookeeper: -bootstrap/librdkafka/src/rdkafka_transport.c:278: undefined reference to `ERR_get_error_line_data'
==> zookeeper: tmp-bootstrap/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function `rd_kafka_transport_ssl_init':
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:339: undefined reference to `CRYPTO_num_locks'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:345: undefined reference to `CRYPTO_set_id_callback'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:346: undefined reference to `CRYPTO_set_locking_callback'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:348: undefined reference to `SSL_load_error_strings'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:349: undefined reference to `SSL_library_init'
==> zookeeper: tmp-bootstrap/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function `rd_kafka_transport_close':
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:81: undefined reference to `SSL_shutdown'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:82: undefined reference to `SSL_free'
==> zookeeper: tmp-bootstrap/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function `rd_kafka_transport_ssl_ctx_term':
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:631: undefined reference to `SSL_CTX_free'
==> zookeeper: tmp-bootstrap/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function `rd_kafka_transport_ssl_ctx_init':
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:650: undefined reference to `SSLv23_client_method'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:650: undefined reference to `SSL_CTX_new'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:656: undefined reference to `SSL_CTX_set_default_passwd_cb'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:657: undefined reference to `SSL_CTX_set_default_passwd_cb_userdata'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:664: undefined reference to `SSL_CTX_set_cipher_list'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:682: undefined reference to `SSL_CTX_load_verify_locations'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:699: undefined reference to `SSL_CTX_use_certificate_file'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:712: undefined reference to `SSL_CTX_use_PrivateKey_file'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:720: undefined reference to `SSL_CTX_ctrl'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:727: undefined reference to `SSL_CTX_free'
==> zookeeper: tmp-bootstrap/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function `rd_kafka_transport_ssl_sendmsg':
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:412: undefined reference to `SSL_write'
==> zookeeper: tmp-bootstrap/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function `rd_kafka_transport_ssl_io_update':
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:364: undefined reference to `SSL_get_error'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:379: undefined reference to `SSL_get_error'
==> zookeeper: tmp-bootstrap/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function `rd_kafka_transport_ssl_connect':
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:506: undefined reference to `SSL_new'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:510: undefined reference to `SSL_set_fd'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:513: undefined reference to `SSL_connect'
==> zookeeper: tmp-bootstrap/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function `rd_kafka_transport_ssl_io_update':
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:364: undefined reference to `SSL_get_error'
==> zookeeper: tmp-bootstrap/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function `rd_kafka_transport_ssl_handhsake':
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:597: undefined reference to `SSL_do_handshake'
==> zookeeper: tmp-bootstrap/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function `rd_kafka_transport_ssl_io_update':
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:364: undefined reference to `SSL_get_error'
==> zookeeper: tmp-bootstrap/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function `rd_kafka_transport_ssl_verify':
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:564: undefined reference to `SSL_get_peer_certificate'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:565: undefined reference to `X509_free'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:573: undefined reference to `SSL_get_verify_result'
==> zookeeper: tmp-bootstrap/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function `rd_kafka_transport_ssl_io_update':
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:379: undefined reference to `SSL_get_error'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:379: undefined reference to `SSL_get_error'
==> zookeeper: tmp-bootstrap/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function `rd_kafka_transport_ssl_verify':
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:574: undefined reference to `X509_verify_cert_error_string'
==> zookeeper: tmp-bootstrap/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function `rd_kafka_transport_ssl_recvmsg':
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:444: undefined reference to `SSL_read'
==> zookeeper: tmp-bootstrap/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function `rd_kafka_transport_ssl_io_update':
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:364: undefined reference to `SSL_get_error'
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:379: undefined reference to `SSL_get_error'
==> zookeeper: tmp-bootstrap/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function `rd_kafka_transport_ssl_init':
==> zookeeper: /opt/github/edenhill/kafkacat/tmp-bootstrap/librdkafka/src/rdkafka_transport.c:350: undefined reference to `OPENSSL_add_all_algorithms_noconf'
==> zookeeper: collect2: ld returned 1 exit status
==> zookeeper: make: 
==> zookeeper: *** [kafkacat] Error 1
The SSH command responded with a non-zero exit status. Vagrant
assumes that this means the command failed. The output for this command
should be in the log above. Please read the output to determine what
went wrong.
joestein commented 8 years ago

Hey @prayagupd we haven't upgraded yet to 0.9.0.0 we are working on a consumer scala wrapper for that now as a new Storm Spout. @kgelles when we do that it might make sense to push that here for now as we are testing it and then contrib it back in to the other topologies too with whatever other changes folks make.

@prayagupd That specific error looks like the kafkacat (wraps librdkafka) got upgraded we should probably update master and the branch with the tag build not the latest trunk build. I suspect that would fix this you can try just to comment out the kafkacat install too see any more issues?

edenhill commented 8 years ago

This should be fixed in kafkacat now. Log in to the vagrant instances, run rm -rf /opt/edenhill/kafkacat, log out and then do vagrant provision to rebuild. Should do the trick.

prayagupa commented 8 years ago

@edenhill you are awesome !!! Your presence just fixed all !!! Thanks @joestein for looking into this.