When importing large data from OceanBase to Doris through the seatunnel, the task stops

[jeana-zxy]

Search before asking

• [X] I had searched in the issues and found no similar issues.

What happened

When importing large data (14943611 rows) from OceanBase to Doris through the seatunnel, the task stops. But when the data is less than 1000 rows, it will write successfully. doris version: doris-2.0.1-rc04-30d35c4 oceanbase version: 4.2.1

SeaTunnel Version

seatunnel-2.3.2

SeaTunnel Config

seatunel config 
env {
  executionn.parallelism = 3
  job.mode = "BATCH"
  checkpoint.interval = 1000
}

source {
    Jdbc {
        url = "jdbc:mysql://xxxxxxxx:2883/saas_data?serverTimezone=Asia/Shanghai"
        driver = "com.mysql.cj.jdbc.Driver"
        connection_check_timeout_sec = 300
        user = "root@xxx#xxx"
        password = "xxx"
        parallelism = 1
        fetch_size = 10000
        result_table_name = "xxx"
        query = "select * from test where pt = '20231119'"
    }
}

sink {
    Doris {
        fenodes = "172.16.0.42:8030"
        username = root
        password = "xxx"
        table.identifier = "saas_data.test"
        sink.enable-2pc = "false"
        sink.label-prefix = "test_json"
        doris.config = {
            format="json"
            read_json_by_line="true"
        }
    }

}

Running Command

seatunnel.sh -c v2.batch.config.template

Error Exception

i have not found any error log

Zeta or Flink or Spark Version

No response

Java or Scala Version

No response

Screenshots

Are you willing to submit PR?

• [ ] Yes I am willing to submit a PR!

Code of Conduct

• [X] I agree to follow this project's Code of Conduct

[XiaoGerGer]

I also encountered the same situation when I used Doris Sink, the progress bar of the console slowly became 0 and then remained stuck at 0. And when I open the DEBUG log, I find that the output StreamLoad Result statistics are not consistent with the number of actually imported ones, and the number of threads in the container keeps growing

[XiaoGerGer]

Even when I try to use Doris sink, SeaTunnel does not report an error even though the Doris table does not exist, it just keeps getting stuck in the progress bar 0 and the background thread keeps growing