apache / seatunnel

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
https://seatunnel.apache.org/
Apache License 2.0
7.59k stars 1.67k forks source link

flink on yarn execute fail (Provider org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSource not a subtype) #6891

Open ljl568419709 opened 1 month ago

ljl568419709 commented 1 month ago

Search before asking

Description

version seatunall 2.3.3 flink 1.3.6 cmd : ./bin/start-seatunnel-flink-13-connector-v2.sh -e run-application --master yarn-application --config /apps/hive/apache-seatunnel-2.3.3/config/v2.batch.config.mysql_mysql.template --name SeaTunnel

env { parallelism = 4 job.mode = "BATCH" } source{ jdbc { url = "jdbc:mysql://10.26.32.16:3306/communal_new?serverTimezone=GMT%2b8&useUnicode=true&characterEncoding=UTF-8&rewriteBatchedStatements=true" driver = "com.mysql.cj.jdbc.Driver" connection_check_timeout_sec = 100 user = "root" password = "Meicloud12#$" query = "select * from sys_menu" } }

transform {

If you would like to get more information about how to configure seatunnel and see full list of transform plugins,

# please go to https://seatunnel.apache.org/docs/transform-v2/sql

}

sink { jdbc { url = "jdbc:mysql://10.26.32.16:3306/test" driver = "com.mysql.cj.jdbc.Driver" user = "root" password = "Meicloud12#$"

Automatically generate sql statements based on database table names

    generate_sink_sql = true
    database = test
    table = sys_menu
}

}

1 2 3 我怀疑有没有人测试过

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

Code of Conduct

ljl568419709 commented 1 month ago

jdbc jar sumbited yarn 5

4

ljl568419709 commented 1 month ago

而且seatunnel提交到yarn时,并没有将connectors/seatunnel提交到yarn,导致seatunnel找不到,上面的日志截图也有说明,这个是还有遗漏其他配置吗

guojp00 commented 1 month ago

I have also encountered this problem,same as you . and it is not work for this solution #6068

github-actions[bot] commented 2 weeks ago

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.