Closed BigdataSurvey closed 2 months ago
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
@BigdataSurvey did you resolve this problem?
This problem has not been solved yet. Please help
At 2024-09-02 16:26:32, "Yuan Gao" @.***> wrote:
@BigdataSurvey did you resolve this problem?
— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.***>
Search before asking
What happened
从Mysql 抽取数据到Doris。会有两种情况:
情况1:刚开始前两分钟正常,后面日志报错: Label already error。可是我每次启动的时候都会去修改"*.conf.template" 配置文件中"sink.label-prefix" 项来保证每次启动唯一,但是运行几分钟之后还是报错。经过进一步测试, 发现在配置文件中"Mysql Source"中配置了多表, 导致再多个表数据同一时间修改后通过Doris传输报错 Label already error,只配置一张表是没有问题的,但是业务场景需要将很多分表写到一个doris表中。请问这个问题有解决方案吗?
情况2:任务在执行过程中被中断 (InterruptedException) 线程在等待某些资源或条件时被其他线程中断,但是服务器配置和网络通信都没有压力目前。
服务配置:Seatunnel集群共4台服务器,资源环境良好, 版本是2.3.5 版本。Doris版本为2.1.2
Extract data from Mysql to Doris. There are two kinds of errors:
Situation 1: The log is normal for the first two minutes. Later, a Label already error is reported. However, I would modify the "sink.label-prefix" item in the "*.conf.template" configuration file every time I started to ensure that the startup was unique, but an error was still reported after running for several minutes. After further testing, it was found that multiple tables were configured in the "Mysql Source" configuration file. After the data of multiple tables is modified at the same time, a Label already error is reported through the Doris transmission. It is OK to configure only one table, but many sub-tables need to be written to one doris table in a service scenario. Is there a solution to this problem?
Situation 2: A task is interrupted during execution (InterruptedException) A thread is interrupted by another thread while waiting for some resource or condition, but neither server configuration nor network communication is currently under stress.
Service configuration: There are four servers in the Seatunnel cluster, the resource environment is good, and the version is 2.3.5. The Doris version is 2.1.2
SeaTunnel Version
SeaTunnel Version: 2.3.5 Doris Version: 2.1.2
SeaTunnel Config
Running Command
Error Exception
Zeta or Flink or Spark Version
No response
Java or Scala Version
1.8.0_181
Screenshots
No response
Are you willing to submit PR?
Code of Conduct