apache / pekko-connectors

Apache Pekko Connectors is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Apache Pekko.
https://pekko.apache.org/
Apache License 2.0
62 stars 31 forks source link

Using apache kudu docker images and update kudu-client version #626

Closed laglangyue closed 5 months ago

laglangyue commented 5 months ago

motivation

we use the kudu images but not from apache,so update it, and update the version Although I am not an expert in kudu, I am capable of solving this problem. I did some digging and found that the new version of kudu will try TLS connection, so the connection failed

test

test it locally ok

future

I add encryptionPolicy(EncryptionPolicy.OPTIONAL) to client temporaryly. It need to some improvment for client. In my opinion, we should provide a way for users to pass us a client that can be customized by the user

  public enum EncryptionPolicy {
    // Optional, it uses encrypted connection if the server supports it
    // but it can connect to insecure servers too.
    OPTIONAL,
    // Only connects to remote servers that support encryption, fails
    // otherwise. It can connect to insecure servers only locally.
    REQUIRED_REMOTE,
    // Only connects to any server, including on the loopback interface,
    // that support encryption, fails otherwise.
    REQUIRED,
  }
laglangyue commented 5 months ago

@pjfanning I know you've made some efforts for Kudu before, what do you think?

laglangyue commented 5 months ago

reference to https://github.com/apache/kudu/blob/master/docker/quickstart.yml

laglangyue commented 5 months ago

I check the log about container. image

Then I found a issue about kudu TLS https://issues.apache.org/jira/browse/KUDU-2647

laglangyue commented 5 months ago

I check it again, I add a config for EncryptionPolicy. PTAL @pjfanning In fact, implementation of kudu connector is too simple, and If I have time, I will submit a pr in futrue.

pjfanning commented 5 months ago

Thanks - I've restarted the CI runs

pjfanning commented 5 months ago

Thanks @laglangyue - merged. I have labelled this as needing a mention in the release notes due to the new config.