apache / seatunnel

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
https://seatunnel.apache.org/
Apache License 2.0
7.84k stars 1.77k forks source link

[Bug] [jdbc] 任务会卡主 #7449

Open 13813586515 opened 1 month ago

13813586515 commented 1 month ago

Search before asking

What happened

使用ds来调度st,任务会卡住,导致定时跑的任务无法继续

SeaTunnel Version

2.3.6

SeaTunnel Config

env {
  parallelism = 10
  job.mode = "BATCH"
}

source {
    Jdbc {
        driver = com.microsoft.sqlserver.jdbc.SQLServerDriver
        url = "jdbc:sqlserver://192.168.0.123:1433;databaseName=BSERP3_LP"
        user = sa
        password = "123"
        # Define query logic as required
      table_list = [
        {
          table_path = "BSERP3_LP.dbo.fjsx9"
          # Use query filetr rows & columns
          query = "select * from BSERP3_LP.dbo.fjsx9 "
        }

    ]

    }
}

sink {
  Doris {
    fenodes = "192.168.0.168:8030,192.168.0.169:8030,192.168.0.170:8030"
    username = root
    password = "123"
    database = "ods_bs"
    table = "ods_${table_name}"
    # 保证每个文件唯一,拷贝之后文件需要修改此处
    sink.label-prefix = "bs-product-${table_name}-jdbc"
    sink.enable-2pc = "true"
    # sink.enable-delete = "true"
    save_mode_create_template="CREATE TABLE IF NOT EXISTS `${database}`.`${table_name}` (${rowtype_fields},dt datetime(0) default current_timestamp(0) on update current_timestamp(0)) ENGINE=OLAP UNIQUE KEY (SXDM) DISTRIBUTED BY HASH (SXDM) BUCKETS 3 PROPERTIES ( \"replication_allocation\" = \"tag.location.default: 1\",\"in_memory\" = \"false\",\"storage_format\" = \"V2\", \"disable_auto_compaction\" = \"false\")"
    doris.config {
      format = "json"
      read_json_by_line = "true"
    }
  }
}

Running Command

集群

Error Exception

任务卡主不动

Zeta or Flink or Spark Version

No response

Java or Scala Version

No response

Screenshots

image image image

Are you willing to submit PR?

Code of Conduct

github-actions[bot] commented 3 days ago

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.