search

apache / seatunnel

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
https://seatunnel.apache.org/
Apache License 2.0
7.86k stars 1.77k forks source link

[Feature][Connector-V2] Dependency conflicts exist in connector-cdc-sqlserver and connector-maxcompute. #6772

Open HappyHacker123 opened 5 months ago

HappyHacker123 commented 5 months ago

Search before asking

Description

Problem Description

Currently, seatunnel-connectors-v2/connector-cdc/connector-cdc-sqlserver and seatunnel-connectors-v2/connector-maxcompute is encountering dependency conflicts. Specifically, they contain classes with the same qualified class names in their dependencies as listed below. 

Dep org.apache.seatunnel:connector-cdc-sqlserver:2.3.2:
    Pulled in by:   [org.apache.seatunnel:connector-cdc-sqlserver:2.3.2::]
Dep io.debezium:debezium-connector-sqlserver:1.6.4.Final:
    Pulled in by:   [org.apache.seatunnel:connector-cdc-sqlserver:2.3.2:: -> io.debezium:debezium-connector-sqlserver:1.6.4.Final::compile]
Contains Duplicate Classes: 1
    io.debezium.connector.sqlserver.SqlServerStreamingChangeEventSource
----
Dep org.apache.seatunnel:connector-maxcompute:2.3.2:
    Pulled in by:   [org.apache.seatunnel:connector-maxcompute:2.3.2::]
Dep com.aliyun.odps:odps-sdk-commons:0.31.3-public:
    Pulled in by:   [org.apache.seatunnel:connector-maxcompute:2.3.2:: -> com.aliyun.odps:odps-sdk-core:0.31.3-public::compile -> com.aliyun.odps:odps-sdk-commons:0.31.3-public::compile]
Contains Duplicate Classes: 3
    com.aliyun.odps.type.SimpleMapTypeInfo
    com.aliyun.odps.type.SimpleStructTypeInfo
    com.aliyun.odps.type.SimpleArrayTypeInfo
----

The behavior of the Java classloader indictates that when multiple classes with the same fully qualified name exist on the classpath, only one instance of the class will be loaded into memory at runtime. This means that the classes defined here may actually not be loaded, leading to runtime error or semantic conflicts, etc.

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

Code of Conduct

HappyHacker123 commented 4 months ago

Could you please take a look at this issue @hailin0 @Carl-Zhou-CN ? many thanks :)

github-actions[bot] commented 3 months ago

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.