apache / seatunnel

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
https://seatunnel.apache.org/
Apache License 2.0
8.02k stars 1.82k forks source link

MySQL Jdbc 导数据导同服务下的另一个库异常 #4998

Open DreamWingsGO opened 1 year ago

DreamWingsGO commented 1 year ago

Search before asking

What happened

MySQL Jdbc 导数据导同服务下的另一个库 一直显示一样的日志

SeaTunnel Version

2.3.2

SeaTunnel Config

env {
  execution.parallelism = 2
  job.mode = "BATCH"
  # 10秒检查一次,可以适当加大这个值
  checkpoint.interval = 20000
}

source {
  Jdbc {
    user = "root"
    password = "root"
    driver = "com.mysql.cj.jdbc.Driver"
    url = "jdbc:mysql://10.0.0.15:59001/ga?useUnicode=true&characterEncoding=utf8&serverTimezone=Asia/Shanghai"
    query = "select * from user"
    connection_check-timeout_sec = 100
  }
}

transform{
}

sink {
  jdbc {
    url = "jdbc:mysql://10.0.0.15:59001/demo?useUnicode=true&characterEncoding=utf8&serverTimezone=Asia/Shanghai"
    driver = "com.mysql.cj.jdbc.Driver"
    user = "root"
    password = "root"
    xa_data_source_class_name = "com.mysql.cj.jdbc.MysqlXADataSource"
    query = "INSERT INTO demo.user (id, userId, mobile, user_uuid, wx_id, real_name, user_id_card, nickname, market_channel, gender, birthday, created_time, last_update_time, status, push_id, avatar_image_res_id) VALUES (?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?)"
  }
}

Running Command

./bin/seatunnel.sh --config ./config/seatunnel.mysql.conf.template -e local

Error Exception

2023-06-29 16:52:04,205 INFO  org.apache.seatunnel.engine.server.CoordinatorService - [localhost]:6801 [seatunnel-335839] [5.1]
***********************************************
     CoordinatorService Thread Pool Status
***********************************************
activeCount               :                   1
corePoolSize              :                   0
maximumPoolSize           :          2147483647
poolSize                  :                   1
completedTaskCount        :                  15
taskCount                 :                  16
***********************************************

2023-06-29 16:52:04,206 INFO  org.apache.seatunnel.engine.server.CoordinatorService - [localhost]:6801 [seatunnel-335839] [5.1]
***********************************************
                Job info detail
***********************************************
createdJobCount           :                   0
scheduledJobCount         :                   0
runningJobCount           :                   1
failingJobCount           :                   0
failedJobCount            :                   0
cancellingJobCount        :                   0
canceledJobCount          :                   0
finishedJobCount          :                   0
restartingJobCount        :                   0
suspendedJobCount         :                   0
reconcilingJobCount       :                   0
***********************************************

2023-06-29 16:52:07,072 INFO  org.apache.seatunnel.engine.client.job.JobMetricsRunner -
***********************************************
           Job Progress Information
***********************************************
Job Id                    :  726719814378192897
Read Count So Far         :                3048
Write Count So Far        :                 999
Average Read Count        :                 0/s
Average Write Count       :                 0/s
Last Statistic Time       : 2023-06-29 16:51:07
Current Statistic Time    : 2023-06-29 16:52:07
***********************************************

Flink or Spark Version

No response

Java or Scala Version

jdk 11.0.19

Screenshots

4e495aea11ab90d9d07e6db3d389ca9 57db584924ed5a2644d1b6039d11bc0 0e088ba4a82dbbe229803b39928eab2

Are you willing to submit PR?

Code of Conduct

DreamWingsGO commented 1 year ago

新的表一直没有数据

samgang commented 1 year ago

你的数据库版本是多少,驱动版本是多少

DreamWingsGO commented 1 year ago

你的数据库版本是多少,驱动版本是多少

MySQL8.0.21 mysql-connector-java-8.0.21.jar

github-actions[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.