apache / seatunnel

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
https://seatunnel.apache.org/
Apache License 2.0
8.05k stars 1.83k forks source link

[Bug] [2.3.8] Seatunnel-2.3.8 Add new plug-ins #8084

Closed Doooing closed 2 days ago

Doooing commented 2 days ago

Search before asking

What happened

Customize a plug-in in seatunnel-transfoms-v2. After repackaging, uploading and replacing the original transform.jar, use the plug-in to report errors in data synchronization. And similar operations take effect normally in seatunnel-2.3.3 and can be performed successfully.

SeaTunnel Version

seatunnel-2.3.8

SeaTunnel Config

transform {
  Custom_plug_name {
    source_table_name = "fake"
    result_table_name = "fake1"
    custom_option = xxxxxx
  }
}

Running Command

$SEATUNNEL_HOME/bin/seatunnel.sh --config xxxxx.conf -m local

Error Exception

ErrorCode:[API-06], Factory initialize failed - Could not find any factories that implement 'org.apache.seatunnel.api.table.factory.TableTransformFactory' in the classpath.

Zeta or Flink or Spark Version

zeta

Java or Scala Version

No response

Screenshots

No response

Are you willing to submit PR?

Code of Conduct

Doooing commented 2 days ago

In seatunnel-2.3.3, you can modify the code, package, upload and replace the original transform.jar, and you can directly use the new plug-ins.

Doooing commented 2 days ago

It has been solved. In seatunnel-2.3.8, after customizing the plug-in, you need to configure the new plug-in information to $SEATUNNEL_HOME/connectors/plugin-mapping.properties. For example, add it to the file: seatunnel.transform.Custom_plug_name = seatunnel-transforms-v2