search

apache / pulsar

Apache Pulsar - distributed pub-sub messaging system
https://pulsar.apache.org/
Apache License 2.0
14.12k stars 3.57k forks source link

Remove Kafka related dependencies from core-modules #10958

Closed BewareMyPower closed 1 year ago

BewareMyPower commented 3 years ago

Is your enhancement request related to a problem? Please describe. When I build Pulsar on CentOS 7 using following command:

mvn clean install -DskipTests -Pcore-modules

it always failed.

[ERROR] Failed to execute goal on project kafka-connect-avro-converter-shaded: Could not resolve dependencies for project org.apache.pulsar:kafka-connect-avro-converter-shaded:jar:2.9.0-SNAPSHOT: Could not transfer artifact io.confluent:common-config:jar:5.3.2 from/to confluent (https://packages.confluent.io/maven/): Transfer failed for https://packages.confluent.io/maven/io/confluent/common-config/5.3.2/common-config-5.3.2.jar: Received close_notify during handshake -> [Help 1]

Describe the solution you'd like

I'm not sure if it's caused by my limited network environment. Maybe I need to configure a proxy to download dependencies from io.confluent.

However, it's weird that Confluent's JARs are the core modules of Pulsar. Should we remove them from core-modules?

Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.

Additional context

The build summary:

[INFO] Reactor Summary for Pulsar 2.9.0-SNAPSHOT:
[INFO] 
[INFO] Pulsar Build Tools ................................. SUCCESS [  4.442 s]
[INFO] Pulsar ............................................. SUCCESS [  2.095 s]
[INFO] Pulsar Test Mocks .................................. SUCCESS [  2.700 s]
[INFO] Pulsar Client :: API ............................... SUCCESS [  1.989 s]
[INFO] Pulsar Client Admin :: API ......................... SUCCESS [  5.715 s]
[INFO] Pulsar Common ...................................... SUCCESS [ 35.758 s]
[INFO] Pulsar Metadata .................................... SUCCESS [ 13.680 s]
[INFO] Managed Ledger ..................................... SUCCESS [  7.084 s]
[INFO] Apache Pulsar :: Jclouds shaded .................... SUCCESS [  3.588 s]
[INFO] Apache Pulsar :: Tiered Storage :: Parent .......... SUCCESS [  0.304 s]
[INFO] Apache Pulsar :: Tiered Storage :: JCloud .......... SUCCESS [ 18.479 s]
[INFO] Apache Pulsar :: Tiered Storage :: File System ..... SUCCESS [ 12.046 s]
[INFO] Pulsar ZooKeeper Utils ............................. SUCCESS [  2.755 s]
[INFO] pulsar-broker-common ............................... SUCCESS [  3.382 s]
[INFO] Pulsar Transaction :: Parent ....................... SUCCESS [  0.215 s]
[INFO] Pulsar Transaction :: Common ....................... SUCCESS [  2.898 s]
[INFO] Apache Pulsar :: Bouncy Castle :: Parent ........... SUCCESS [  0.129 s]
[INFO] Apache Pulsar :: Bouncy Castle :: BC ............... SUCCESS [  0.863 s]
[INFO] pulsar-client-messagecrypto-bc ..................... SUCCESS [  0.538 s]
[INFO] Pulsar Functions :: Parent ......................... SUCCESS [  0.180 s]
[INFO] Pulsar Functions :: Proto .......................... SUCCESS [  2.508 s]
[INFO] Pulsar Client Java ................................. SUCCESS [ 32.619 s]
[INFO] Pulsar Discovery Service WAR ....................... SUCCESS [  4.432 s]
[INFO] Pulsar WebSocket ................................... SUCCESS [ 14.420 s]
[INFO] Apache Pulsar :: Package Management ................ SUCCESS [  0.263 s]
[INFO] Apache Pulsar :: Package Management :: Core ........ SUCCESS [  7.944 s]
[INFO] Pulsar Client Admin Original ....................... SUCCESS [  6.066 s]
[INFO] Pulsar Functions :: API ............................ SUCCESS [  3.873 s]
[INFO] Pulsar IO :: Parent ................................ SUCCESS [  0.178 s]
[INFO] Pulsar IO :: IO .................................... SUCCESS [  3.304 s]
[INFO] Pulsar IO :: Batch Discovery Triggerers ............ SUCCESS [  3.065 s]
[INFO] pulsar-config-validation ........................... SUCCESS [  0.973 s]
[INFO] Pulsar Functions :: Utils .......................... SUCCESS [  2.772 s]
[INFO] Pulsar Functions :: Secrets ........................ SUCCESS [  4.800 s]
[INFO] Pulsar Functions :: Instance ....................... SUCCESS [ 15.491 s]
[INFO] Pulsar Functions :: Runtime ........................ SUCCESS [  3.494 s]
[INFO] Pulsar IO :: Cassandra ............................. SUCCESS [  1.097 s]
[INFO] Pulsar IO :: IO Common ............................. SUCCESS [  3.865 s]
[INFO] Pulsar IO :: Twitter ............................... SUCCESS [  1.813 s]
[INFO] Pulsar Functions :: API Examples ................... SUCCESS [  4.741 s]
[INFO] Pulsar Functions :: Worker ......................... SUCCESS [  5.424 s]
[INFO] Pulsar Functions :: Local Runner original .......... SUCCESS [  6.888 s]
[INFO] Pulsar IO :: Batch Data Generator .................. SUCCESS [  8.598 s]
[INFO] Pulsar IO :: Data Generator ........................ SUCCESS [  2.612 s]
[INFO] Pulsar Transaction :: Coordinator .................. SUCCESS [  8.903 s]
[INFO] Pulsar Broker ...................................... SUCCESS [ 34.013 s]
[INFO] Pulsar Shaded Broker ............................... SUCCESS [ 33.740 s]
[INFO] Pulsar Client Java ................................. SUCCESS [ 19.959 s]
[INFO] Pulsar Client 1.x Compatibility Base ............... SUCCESS [  0.131 s]
[INFO] Pulsar Client 2.x Shaded API ....................... SUCCESS [ 14.388 s]
[INFO] Pulsar Client 1.x Compatibility API ................ SUCCESS [  8.613 s]
[INFO] Pulsar Client Admin ................................ SUCCESS [  9.358 s]
[INFO] Pulsar Client Tools ................................ SUCCESS [  4.825 s]
[INFO] Pulsar Client Tools Test ........................... SUCCESS [  3.219 s]
[INFO] Pulsar Client All .................................. SUCCESS [ 22.773 s]
[INFO] Pulsar Proxy ....................................... SUCCESS [  4.263 s]
[INFO] Pulsar Test Client ................................. SUCCESS [  3.438 s]
[INFO] pulsar-broker-auth-athenz .......................... SUCCESS [  6.929 s]
[INFO] pulsar-client-auth-athenz .......................... SUCCESS [  6.632 s]
[INFO] Pulsar SQL :: Parent ............................... SUCCESS [  0.165 s]
[INFO] Pulsar SQL :: Pulsar Presto Connector Packaging .... SUCCESS [  8.084 s]
[INFO] Pulsar SQL :: Pulsar Presto Connector .............. SUCCESS [  9.091 s]
[INFO] Pulsar SQL :: Pulsar Presto Distribution ........... SUCCESS [  8.991 s]
[INFO] Apache Pulsar :: Docker Images ..................... SUCCESS [  0.133 s]
[INFO] Apache Pulsar :: Docker Images :: Pulsar Dashboard . SUCCESS [  0.140 s]
[INFO] pulsar-client-auth-sasl ............................ SUCCESS [  0.807 s]
[INFO] pulsar-broker-auth-sasl ............................ SUCCESS [  2.776 s]
[INFO] Pulsar Functions :: Runtime All .................... SUCCESS [  4.375 s]
[INFO] Apache Pulsar :: Kafka Connect Avro Converter shaded FAILURE [ 31.477 s]
[INFO] Apache Pulsar :: Bouncy Castle :: BC-FIPS .......... SKIPPED
[INFO] Pulsar Bouncy Castle FIPS Test ..................... SKIPPED
[INFO] Apache Pulsar :: Package Management :: BookKeeper Storage SKIPPED
[INFO] Pulsar :: Distribution ............................. SKIPPED
[INFO] Pulsar :: Distribution :: Server ................... SKIPPED
[INFO] Apache Pulsar :: Docker Images :: Pulsar Latest Version SKIPPED
[INFO] Apache Pulsar :: Docker Images :: Grafana .......... SKIPPED
[INFO] Apache Pulsar :: Docker Images :: Pulsar Latest Version (Include All Components) SKIPPED
[INFO] Apache Pulsar :: Docker Images :: Pulsar Standalone  SKIPPED
[INFO] Apache Pulsar :: Tests ............................. SKIPPED
[INFO] Apache Pulsar :: Tests :: Docker Images ............ SKIPPED
[INFO] Apache Pulsar :: Tests :: Docker Images :: Java Test Functions SKIPPED
[INFO] Apache Pulsar :: Tests :: Docker Images :: Latest Version Testing SKIPPED
[INFO] Apache Pulsar :: Tests :: Docker Images :: Java Test Image SKIPPED
[INFO] Apache Pulsar :: Tests :: Integration .............. SKIPPED
[INFO] Apache Pulsar :: Tests :: Backwards Client Compatibility 2.0.0-rc1-incubating SKIPPED
[INFO] Apache Pulsar :: Tests :: Backwards Client Compatibility 2.0.1-incubating SKIPPED
[INFO] Apache Pulsar :: Tests :: Backwards Client Compatibility 2.6.0 SKIPPED
[INFO] Apache Pulsar :: Tests :: Pulsar-Client-All-Shade Test SKIPPED
[INFO] Apache Pulsar :: Tests :: Pulsar-Client-Shade Test . SKIPPED
[INFO] Apache Pulsar :: Tests :: Pulsar-Client-Admin-Shade Test SKIPPED
codelipenghui commented 2 years ago

The issue had no activity for 30 days, mark with Stale label.

tisonkun commented 1 year ago

This can be fixed by https://github.com/apache/pulsar/pull/19468