search

datavane / datavines

Know your data better！Datavines is Next-gen Data Observability Platform, support metadata manage and data quality.
https://datavane.github.io/datavines-website/
Apache License 2.0
430 stars 143 forks source link

[Bug] [Common] When the datavines application is running, the task will remain stuck and cannot be completed after the datavines metabase is restarted #348

Closed xxzuo closed 7 months ago

xxzuo commented 7 months ago

Search before asking

What happened

When the datavines application is running, the task will remain stuck and cannot be completed after the datavines metabase is restarted.

  1. datavines, connecting to local MySQL
  2. Execute a task first and run it normally
  3. Then restart the local MySQL 4.When restarting, datavines reported an exception of being unable to connect to the database
  4. After restarting MySQL, execute another task. At this time, the task status will remain running, and it will timeout and be killed.

DataVines Version

datavines: dev mysql: 5.7.44

DataVines Config

nothing

Running Command

nothing

Error Exception

[WARN] 2024-01-24 13:28:40.975 com.alibaba.druid.pool.DruidDataSource:[1311] - get connection timeout retry : 1
[ERROR] 2024-01-24 13:28:46.977 [JobExecutionUniqueId=JOB-20240124-client_local_134:[72] - get connection error :
com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 6001, active 0, maxActive 10, creating 0, createErrorCount 2
    at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1579)
    at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1306)
    at com.alibaba.druid.filter.FilterChainImpl.dataSource_connect(FilterChainImpl.java:5007)
    at com.alibaba.druid.filter.stat.StatFilter.dataSource_getConnection(StatFilter.java:680)
    at com.alibaba.druid.filter.FilterChainImpl.dataSource_connect(FilterChainImpl.java:5003)
    at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1284)
    at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1276)
    at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:89)
    at io.datavines.connector.plugin.JdbcDataSourceClient.getConnection(JdbcDataSourceClient.java:64)
    at io.datavines.engine.local.api.entity.ConnectionHolder.getConnection(ConnectionHolder.java:51)
    at io.datavines.engine.local.connector.executor.BaseDataSinkExecutor.checkTableExist(BaseDataSinkExecutor.java:91)
    at io.datavines.engine.local.connector.executor.BaseDataSinkExecutor.executeDataSink(BaseDataSinkExecutor.java:59)
    at io.datavines.engine.local.connector.executor.BaseDataSinkExecutor.innerExecute(BaseDataSinkExecutor.java:51)
    at io.datavines.engine.local.connector.executor.ValidateResultDataSinkExecutor.execute(ValidateResultDataSinkExecutor.java:42)
    at io.datavines.engine.local.connector.BaseJdbcSink.output(BaseJdbcSink.java:104)
    at io.datavines.engine.local.api.LocalExecution.execute(LocalExecution.java:153)
    at io.datavines.engine.core.BaseDataVinesBootstrap.parseConfigAndExecute(BaseDataVinesBootstrap.java:79)
    at io.datavines.engine.core.BaseDataVinesBootstrap.execute(BaseDataVinesBootstrap.java:43)
    at io.datavines.engine.local.executor.LocalEngineExecutor.execute(LocalEngineExecutor.java:44)
    at io.datavines.server.dqc.executor.runner.JobRunner.run(JobRunner.java:66)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266)
    at java.util.concurrent.FutureTask.run(FutureTask.java)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: com.mysql.cj.jdbc.exceptions.CommunicationsException: Communications link failure

The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.
    at com.mysql.cj.jdbc.exceptions.SQLError.createCommunicationsException(SQLError.java:174)
    at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:64)
    at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:835)
    at com.mysql.cj.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:455)
    at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:240)
    at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:199)
    at com.alibaba.druid.filter.FilterChainImpl.connection_connect(FilterChainImpl.java:156)
    at com.alibaba.druid.filter.stat.StatFilter.connection_connect(StatFilter.java:218)
    at com.alibaba.druid.filter.FilterChainImpl.connection_connect(FilterChainImpl.java:150)
    at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1572)
    at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1636)
    at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2550)
Caused by: com.mysql.cj.exceptions.CJCommunicationsException: Communications link failure

The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
    at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:61)
    at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:105)
    at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:151)
    at com.mysql.cj.exceptions.ExceptionFactory.createCommunicationsException(ExceptionFactory.java:167)
    at com.mysql.cj.protocol.a.NativeProtocol.readMessage(NativeProtocol.java:562)
    at com.mysql.cj.protocol.a.NativeProtocol.readServerCapabilities(NativeProtocol.java:514)
    at com.mysql.cj.protocol.a.NativeProtocol.beforeHandshake(NativeProtocol.java:404)
    at com.mysql.cj.protocol.a.NativeProtocol.connect(NativeProtocol.java:1450)
    at com.mysql.cj.NativeSession.connect(NativeSession.java:165)
    at com.mysql.cj.jdbc.ConnectionImpl.connectOneTryOnly(ConnectionImpl.java:955)
    at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:825)
    ... 9 common frames omitted
Caused by: java.io.EOFException: Can not read response from server. Expected to read 4 bytes, read 0 bytes before connection was unexpectedly lost.
    at com.mysql.cj.protocol.FullReadInputStream.readFully(FullReadInputStream.java:67)
    at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:63)
    at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:45)
    at com.mysql.cj.protocol.a.NativeProtocol.readMessage(NativeProtocol.java:556)
    ... 15 common frames omitted
[WARN] 2024-01-24 13:28:46.977 [JobExecutionUniqueId=JOB-20240124-client_local_135:[95] - table dv_job_execution_result is not exist
[WARN] 2024-01-24 13:28:52.978 com.alibaba.druid.pool.DruidDataSource:[1311] - get connection timeout retry : 1
[ERROR] 2024-01-24 13:28:58.979 [JobExecutionUniqueId=JOB-20240124-client_local_134:[72] - get connection error :
com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 6000, active 0, maxActive 10, creating 0, createErrorCount 2
    at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1579)
    at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1306)
    at com.alibaba.druid.filter.FilterChainImpl.dataSource_connect(FilterChainImpl.java:5007)
    at com.alibaba.druid.filter.stat.StatFilter.dataSource_getConnection(StatFilter.java:680)
    at com.alibaba.druid.filter.FilterChainImpl.dataSource_connect(FilterChainImpl.java:5003)
    at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1284)
    at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1276)
    at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:89)
    at io.datavines.connector.plugin.JdbcDataSourceClient.getConnection(JdbcDataSourceClient.java:64)
    at io.datavines.engine.local.api.entity.ConnectionHolder.getConnection(ConnectionHolder.java:51)
    at io.datavines.engine.local.connector.executor.BaseDataSinkExecutor.createTable(BaseDataSinkExecutor.java:101)
    at io.datavines.engine.local.connector.executor.BaseDataSinkExecutor.executeDataSink(BaseDataSinkExecutor.java:60)
    at io.datavines.engine.local.connector.executor.BaseDataSinkExecutor.innerExecute(BaseDataSinkExecutor.java:51)
    at io.datavines.engine.local.connector.executor.ValidateResultDataSinkExecutor.execute(ValidateResultDataSinkExecutor.java:42)
    at io.datavines.engine.local.connector.BaseJdbcSink.output(BaseJdbcSink.java:104)
    at io.datavines.engine.local.api.LocalExecution.execute(LocalExecution.java:153)
    at io.datavines.engine.core.BaseDataVinesBootstrap.parseConfigAndExecute(BaseDataVinesBootstrap.java:79)
    at io.datavines.engine.core.BaseDataVinesBootstrap.execute(BaseDataVinesBootstrap.java:43)
    at io.datavines.engine.local.executor.LocalEngineExecutor.execute(LocalEngineExecutor.java:44)
    at io.datavines.server.dqc.executor.runner.JobRunner.run(JobRunner.java:66)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266)
    at java.util.concurrent.FutureTask.run(FutureTask.java)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: com.mysql.cj.jdbc.exceptions.CommunicationsException: Communications link failure

The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.
    at com.mysql.cj.jdbc.exceptions.SQLError.createCommunicationsException(SQLError.java:174)
    at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:64)
    at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:835)
    at com.mysql.cj.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:455)
    at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:240)
    at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:199)
    at com.alibaba.druid.filter.FilterChainImpl.connection_connect(FilterChainImpl.java:156)
    at com.alibaba.druid.filter.stat.StatFilter.connection_connect(StatFilter.java:218)
    at com.alibaba.druid.filter.FilterChainImpl.connection_connect(FilterChainImpl.java:150)
    at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1572)
    at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1636)
    at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2550)
Caused by: com.mysql.cj.exceptions.CJCommunicationsException: Communications link failure

The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
    at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:61)
    at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:105)
    at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:151)
    at com.mysql.cj.exceptions.ExceptionFactory.createCommunicationsException(ExceptionFactory.java:167)
    at com.mysql.cj.protocol.a.NativeProtocol.readMessage(NativeProtocol.java:562)
    at com.mysql.cj.protocol.a.NativeProtocol.readServerCapabilities(NativeProtocol.java:514)
    at com.mysql.cj.protocol.a.NativeProtocol.beforeHandshake(NativeProtocol.java:404)
    at com.mysql.cj.protocol.a.NativeProtocol.connect(NativeProtocol.java:1450)
    at com.mysql.cj.NativeSession.connect(NativeSession.java:165)
    at com.mysql.cj.jdbc.ConnectionImpl.connectOneTryOnly(ConnectionImpl.java:955)
    at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:825)
    ... 9 common frames omitted
Caused by: java.io.EOFException: Can not read response from server. Expected to read 4 bytes, read 0 bytes before connection was unexpectedly lost.
    at com.mysql.cj.protocol.FullReadInputStream.readFully(FullReadInputStream.java:67)
    at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:63)
    at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:45)
    at com.mysql.cj.protocol.a.NativeProtocol.readMessage(NativeProtocol.java:556)
    ... 15 common frames omitted
[ERROR] 2024-01-24 13:28:58.979 [JobExecutionUniqueId=JOB-20240124-client_local_135:[44] - sink validate result data error : 
io.datavines.common.exception.DataVinesException: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 6000, active 0, maxActive 10, creating 0, createErrorCount 2
    at io.datavines.connector.plugin.JdbcDataSourceClient.getConnection(JdbcDataSourceClient.java:73)
    at io.datavines.engine.local.api.entity.ConnectionHolder.getConnection(ConnectionHolder.java:51)
    at io.datavines.engine.local.connector.executor.BaseDataSinkExecutor.createTable(BaseDataSinkExecutor.java:101)
    at io.datavines.engine.local.connector.executor.BaseDataSinkExecutor.executeDataSink(BaseDataSinkExecutor.java:60)
    at io.datavines.engine.local.connector.executor.BaseDataSinkExecutor.innerExecute(BaseDataSinkExecutor.java:51)
    at io.datavines.engine.local.connector.executor.ValidateResultDataSinkExecutor.execute(ValidateResultDataSinkExecutor.java:42)
    at io.datavines.engine.local.connector.BaseJdbcSink.output(BaseJdbcSink.java:104)
    at io.datavines.engine.local.api.LocalExecution.execute(LocalExecution.java:153)
    at io.datavines.engine.core.BaseDataVinesBootstrap.parseConfigAndExecute(BaseDataVinesBootstrap.java:79)
    at io.datavines.engine.core.BaseDataVinesBootstrap.execute(BaseDataVinesBootstrap.java:43)
    at io.datavines.engine.local.executor.LocalEngineExecutor.execute(LocalEngineExecutor.java:44)
    at io.datavines.server.dqc.executor.runner.JobRunner.run(JobRunner.java:66)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266)
    at java.util.concurrent.FutureTask.run(FutureTask.java)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 6000, active 0, maxActive 10, creating 0, createErrorCount 2
    at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1579)
    at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1306)
    at com.alibaba.druid.filter.FilterChainImpl.dataSource_connect(FilterChainImpl.java:5007)
    at com.alibaba.druid.filter.stat.StatFilter.dataSource_getConnection(StatFilter.java:680)
    at com.alibaba.druid.filter.FilterChainImpl.dataSource_connect(FilterChainImpl.java:5003)
    at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1284)
    at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1276)
    at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:89)
    at io.datavines.connector.plugin.JdbcDataSourceClient.getConnection(JdbcDataSourceClient.java:64)
    ... 17 common frames omitted
Caused by: com.mysql.cj.jdbc.exceptions.CommunicationsException: Communications link failure

The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.
    at com.mysql.cj.jdbc.exceptions.SQLError.createCommunicationsException(SQLError.java:174)
    at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:64)
    at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:835)
    at com.mysql.cj.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:455)
    at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:240)
    at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:199)
    at com.alibaba.druid.filter.FilterChainImpl.connection_connect(FilterChainImpl.java:156)
    at com.alibaba.druid.filter.stat.StatFilter.connection_connect(StatFilter.java:218)
    at com.alibaba.druid.filter.FilterChainImpl.connection_connect(FilterChainImpl.java:150)
    at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1572)
    at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1636)
    at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2550)
Caused by: com.mysql.cj.exceptions.CJCommunicationsException: Communications link failure

The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
    at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:61)
    at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:105)
    at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:151)
    at com.mysql.cj.exceptions.ExceptionFactory.createCommunicationsException(ExceptionFactory.java:167)
    at com.mysql.cj.protocol.a.NativeProtocol.readMessage(NativeProtocol.java:562)
    at com.mysql.cj.protocol.a.NativeProtocol.readServerCapabilities(NativeProtocol.java:514)
    at com.mysql.cj.protocol.a.NativeProtocol.beforeHandshake(NativeProtocol.java:404)
    at com.mysql.cj.protocol.a.NativeProtocol.connect(NativeProtocol.java:1450)
    at com.mysql.cj.NativeSession.connect(NativeSession.java:165)
    at com.mysql.cj.jdbc.ConnectionImpl.connectOneTryOnly(ConnectionImpl.java:955)
    at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:825)
    ... 9 common frames omitted
Caused by: java.io.EOFException: Can not read response from server. Expected to read 4 bytes, read 0 bytes before connection was unexpectedly lost.
    at com.mysql.cj.protocol.FullReadInputStream.readFully(FullReadInputStream.java:67)
    at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:63)
    at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:45)
    at com.mysql.cj.protocol.a.NativeProtocol.readMessage(NativeProtocol.java:556)
    ... 15 common frames omitted
[ERROR] 2024-01-24 13:28:58.989 [JobExecutionUniqueId=JOB-20240124-client_local_135:[160] - execute error
io.datavines.common.exception.DataVinesException: sink validate result data error
    at io.datavines.engine.local.connector.executor.ValidateResultDataSinkExecutor.execute(ValidateResultDataSinkExecutor.java:46)
    at io.datavines.engine.local.connector.BaseJdbcSink.output(BaseJdbcSink.java:104)
    at io.datavines.engine.local.api.LocalExecution.execute(LocalExecution.java:153)
    at io.datavines.engine.core.BaseDataVinesBootstrap.parseConfigAndExecute(BaseDataVinesBootstrap.java:79)
    at io.datavines.engine.core.BaseDataVinesBootstrap.execute(BaseDataVinesBootstrap.java:43)
    at io.datavines.engine.local.executor.LocalEngineExecutor.execute(LocalEngineExecutor.java:44)
    at io.datavines.server.dqc.executor.runner.JobRunner.run(JobRunner.java:66)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266)
    at java.util.concurrent.FutureTask.run(FutureTask.java)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: io.datavines.common.exception.DataVinesException: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 6000, active 0, maxActive 10, creating 0, createErrorCount 2
    at io.datavines.connector.plugin.JdbcDataSourceClient.getConnection(JdbcDataSourceClient.java:73)
    at io.datavines.engine.local.api.entity.ConnectionHolder.getConnection(ConnectionHolder.java:51)
    at io.datavines.engine.local.connector.executor.BaseDataSinkExecutor.createTable(BaseDataSinkExecutor.java:101)
    at io.datavines.engine.local.connector.executor.BaseDataSinkExecutor.executeDataSink(BaseDataSinkExecutor.java:60)
    at io.datavines.engine.local.connector.executor.BaseDataSinkExecutor.innerExecute(BaseDataSinkExecutor.java:51)
    at io.datavines.engine.local.connector.executor.ValidateResultDataSinkExecutor.execute(ValidateResultDataSinkExecutor.java:42)
    ... 12 common frames omitted
Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 6000, active 0, maxActive 10, creating 0, createErrorCount 2
    at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1579)
    at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1306)
    at com.alibaba.druid.filter.FilterChainImpl.dataSource_connect(FilterChainImpl.java:5007)
    at com.alibaba.druid.filter.stat.StatFilter.dataSource_getConnection(StatFilter.java:680)
    at com.alibaba.druid.filter.FilterChainImpl.dataSource_connect(FilterChainImpl.java:5003)
    at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1284)
    at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1276)
    at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:89)
    at io.datavines.connector.plugin.JdbcDataSourceClient.getConnection(JdbcDataSourceClient.java:64)
    ... 17 common frames omitted
Caused by: com.mysql.cj.jdbc.exceptions.CommunicationsException: Communications link failure

The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.
    at com.mysql.cj.jdbc.exceptions.SQLError.createCommunicationsException(SQLError.java:174)
    at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:64)
    at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:835)
    at com.mysql.cj.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:455)
    at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:240)
    at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:199)
    at com.alibaba.druid.filter.FilterChainImpl.connection_connect(FilterChainImpl.java:156)
    at com.alibaba.druid.filter.stat.StatFilter.connection_connect(StatFilter.java:218)
    at com.alibaba.druid.filter.FilterChainImpl.connection_connect(FilterChainImpl.java:150)
    at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1572)
    at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1636)
    at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2550)
Caused by: com.mysql.cj.exceptions.CJCommunicationsException: Communications link failure

The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
    at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:61)
    at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:105)
    at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:151)
    at com.mysql.cj.exceptions.ExceptionFactory.createCommunicationsException(ExceptionFactory.java:167)
    at com.mysql.cj.protocol.a.NativeProtocol.readMessage(NativeProtocol.java:562)
    at com.mysql.cj.protocol.a.NativeProtocol.readServerCapabilities(NativeProtocol.java:514)
    at com.mysql.cj.protocol.a.NativeProtocol.beforeHandshake(NativeProtocol.java:404)
    at com.mysql.cj.protocol.a.NativeProtocol.connect(NativeProtocol.java:1450)
    at com.mysql.cj.NativeSession.connect(NativeSession.java:165)
    at com.mysql.cj.jdbc.ConnectionImpl.connectOneTryOnly(ConnectionImpl.java:955)
    at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:825)
    ... 9 common frames omitted
Caused by: java.io.EOFException: Can not read response from server. Expected to read 4 bytes, read 0 bytes before connection was unexpectedly lost.
    at com.mysql.cj.protocol.FullReadInputStream.readFully(FullReadInputStream.java:67)
    at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:63)
    at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:45)
    at com.mysql.cj.protocol.a.NativeProtocol.readMessage(NativeProtocol.java:556)
    ... 15 common frames omitted
[INFO] 2024-01-24 13:28:58.989 io.datavines.engine.core.BaseDataVinesBootstrap:[125] - Fatal Error, 

[INFO] 2024-01-24 13:28:58.990 io.datavines.engine.core.BaseDataVinesBootstrap:[126] - Reason: sink validate result data error

[INFO] 2024-01-24 13:28:58.990 io.datavines.engine.core.BaseDataVinesBootstrap:[127] - Exception StackTrace: io.datavines.common.exception.DataVinesException: sink validate result data error
    at io.datavines.engine.local.connector.executor.ValidateResultDataSinkExecutor.execute(ValidateResultDataSinkExecutor.java:46)
    at io.datavines.engine.local.connector.BaseJdbcSink.output(BaseJdbcSink.java:104)
    at io.datavines.engine.local.api.LocalExecution.execute(LocalExecution.java:153)
    at io.datavines.engine.core.BaseDataVinesBootstrap.parseConfigAndExecute(BaseDataVinesBootstrap.java:79)
    at io.datavines.engine.core.BaseDataVinesBootstrap.execute(BaseDataVinesBootstrap.java:43)
    at io.datavines.engine.local.executor.LocalEngineExecutor.execute(LocalEngineExecutor.java:44)
    at io.datavines.server.dqc.executor.runner.JobRunner.run(JobRunner.java:66)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266)
    at java.util.concurrent.FutureTask.run(FutureTask.java)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: io.datavines.common.exception.DataVinesException: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 6000, active 0, maxActive 10, creating 0, createErrorCount 2
    at io.datavines.connector.plugin.JdbcDataSourceClient.getConnection(JdbcDataSourceClient.java:73)
    at io.datavines.engine.local.api.entity.ConnectionHolder.getConnection(ConnectionHolder.java:51)
    at io.datavines.engine.local.connector.executor.BaseDataSinkExecutor.createTable(BaseDataSinkExecutor.java:101)
    at io.datavines.engine.local.connector.executor.BaseDataSinkExecutor.executeDataSink(BaseDataSinkExecutor.java:60)
    at io.datavines.engine.local.connector.executor.BaseDataSinkExecutor.innerExecute(BaseDataSinkExecutor.java:51)
    at io.datavines.engine.local.connector.executor.ValidateResultDataSinkExecutor.execute(ValidateResultDataSinkExecutor.java:42)
    ... 12 more
Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 6000, active 0, maxActive 10, creating 0, createErrorCount 2
    at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1579)
    at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1306)
    at com.alibaba.druid.filter.FilterChainImpl.dataSource_connect(FilterChainImpl.java:5007)
    at com.alibaba.druid.filter.stat.StatFilter.dataSource_getConnection(StatFilter.java:680)
    at com.alibaba.druid.filter.FilterChainImpl.dataSource_connect(FilterChainImpl.java:5003)
    at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1284)
    at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1276)
    at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:89)
    at io.datavines.connector.plugin.JdbcDataSourceClient.getConnection(JdbcDataSourceClient.java:64)
    ... 17 more
Caused by: com.mysql.cj.jdbc.exceptions.CommunicationsException: Communications link failure

The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.
    at com.mysql.cj.jdbc.exceptions.SQLError.createCommunicationsException(SQLError.java:174)
    at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:64)
    at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:835)
    at com.mysql.cj.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:455)
    at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:240)
    at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:199)
    at com.alibaba.druid.filter.FilterChainImpl.connection_connect(FilterChainImpl.java:156)
    at com.alibaba.druid.filter.stat.StatFilter.connection_connect(StatFilter.java:218)
    at com.alibaba.druid.filter.FilterChainImpl.connection_connect(FilterChainImpl.java:150)
    at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1572)
    at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1636)
    at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2550)
Caused by: com.mysql.cj.exceptions.CJCommunicationsException: Communications link failure

The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
    at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:61)
    at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:105)
    at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:151)
    at com.mysql.cj.exceptions.ExceptionFactory.createCommunicationsException(ExceptionFactory.java:167)
    at com.mysql.cj.protocol.a.NativeProtocol.readMessage(NativeProtocol.java:562)
    at com.mysql.cj.protocol.a.NativeProtocol.readServerCapabilities(NativeProtocol.java:514)
    at com.mysql.cj.protocol.a.NativeProtocol.beforeHandshake(NativeProtocol.java:404)
    at com.mysql.cj.protocol.a.NativeProtocol.connect(NativeProtocol.java:1450)
    at com.mysql.cj.NativeSession.connect(NativeSession.java:165)
    at com.mysql.cj.jdbc.ConnectionImpl.connectOneTryOnly(ConnectionImpl.java:955)
    at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:825)
    ... 9 more
Caused by: java.io.EOFException: Can not read response from server. Expected to read 4 bytes, read 0 bytes before connection was unexpectedly lost.
    at com.mysql.cj.protocol.FullReadInputStream.readFully(FullReadInputStream.java:67)
    at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:63)
    at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:45)
    at com.mysql.cj.protocol.a.NativeProtocol.readMessage(NativeProtocol.java:556)
    ... 15 more

[INFO] 2024-01-24 13:28:58.995 io.datavines.server.dqc.coordinator.cache.JobExecuteManager:[296] - jobExecution execute response: {"id":0,"jobExecutionId":135,"jobExecutionUniqueId":"client_local_135","jobExecutionName":"test_1706074111809","executePlatformType":"client","engineType":"local","errorDataStorageType":"","errorDataStorageParameter":"","applicationParameter":"{\"name\":\"test_1706074111809\",\"env\":{\"engine\":\"local\",\"type\":\"batch\"},\"sources\":[{\"plugin\":\"jdbc\",\"type\":\"source\",\"config\":{\"src_connector_type\":\"mysql\",\"password\":\"123456\",\"database\":\"datavines\",\"driver\":\"com.mysql.cj.jdbc.Driver\",\"user\":\"root\",\"output_table\":\"dv_actual_values\",\"table\":\"`datavines`.`dv_actual_values`\",\"url\":\"jdbc:mysql://127.0.0.1:3306/datavines?useUnicode=true&characterEncoding=UTF-8&useSSL=false&serverTimezone=Asia/Shanghai&useInformationSchema=true\"}}],\"transforms\":[{\"plugin\":\"sql\",\"type\":\"actual_value\",\"config\":{\"index\":0,\"output_table\":\"invalidate_count_737d9ff3\",\"sql\":\"select count(1) as actual_value_737d9ff3 from `datavines`.`dv_actual_values`\"}}],\"sinks\":[{\"plugin\":\"mysql\",\"type\":\"validate_result\",\"config\":{\"job_execution_id\":135,\"url\":\"jdbc:mysql://127.0.0.1:3307/datavines?useUnicode=true&characterEncoding=UTF-8&useSSL=false&serverTimezone=Asia/Shanghai\",\"sql\":\"INSERT INTO dv_job_execution_result (`job_execution_id`, `metric_unique_key`, `metric_type`, `metric_name`, `metric_dimension`, `database_name`, `table_name`, `column_name`, `actual_value`, `expected_value`, `expected_type`, `result_formula`, `operator`, `threshold`, `create_time`, `update_time`) VALUES (135, '737d9ff3', 'single_table', 'table_row_count', 'completeness', 'datavines', 'dv_actual_values', '', ${actual_value_737d9ff3}, ${expected_value_737d9ff3}, 'none', 'count', 'eq', 0.0, '2024-01-24 13:28:34', '2024-01-24 13:28:34') ON DUPLICATE KEY UPDATE actual_value = '${actual_value_737d9ff3}',update_time='2024-01-24 13:28:34'\",\"src_connector_type\":\"mysql\",\"password\":\"123456\",\"driver\":\"com.mysql.cj.jdbc.Driver\",\"metric_unique_key\":\"737d9ff3\",\"expected_value\":\"expected_value_737d9ff3\",\"user\":\"root\",\"output_table\":\"dv_job_execution_result\",\"table\":\"dv_job_execution_result\"}},{\"plugin\":\"mysql\",\"type\":\"actual_value\",\"config\":{\"job_execution_id\":135,\"url\":\"jdbc:mysql://127.0.0.1:3307/datavines?useUnicode=true&characterEncoding=UTF-8&useSSL=false&serverTimezone=Asia/Shanghai\",\"sql\":\"INSERT INTO dv_actual_values (job_execution_id, metric_name, unique_code, actual_value, data_time, create_time, update_time) VALUES (135, 'table_row_count', 'PZHROQNLY4YWZ5VCOHZ5PNTQNSFEG4EZJSCZ4Y0JEGW=', ${actual_value_737d9ff3}, '2024-01-24 13:28:34', '2024-01-24 13:28:34', '2024-01-24 13:28:34')\",\"src_connector_type\":\"mysql\",\"password\":\"123456\",\"driver\":\"com.mysql.cj.jdbc.Driver\",\"metric_unique_key\":\"737d9ff3\",\"expected_value\":\"expected_value_737d9ff3\",\"user\":\"root\",\"output_table\":\"dv_actual_values\",\"table\":\"dv_actual_values\"}}]}","tenantCode":"","retryTimes":0,"retryInterval":1,"timeout":72,"timeoutStrategy":"RETRY","executeHost":"172.22.224.1:5600","status":6,"applicationId":"-1","processId":-1,"executeFilePath":"/tmp/datavines/exec/job/local/135","logPath":"D:\\code_repo\\bigdata_opensource\\dev_datavines\\datavines/logs/job/20240124/client_local_135.log","env":"","startTime":"2024-01-24T13:28:34.946","endTime":"2024-01-24T13:28:58.99","en":false}
[INFO] 2024-01-24 13:29:48.960 io.datavines.server.dqc.coordinator.cache.JobExecuteManager:[401] - jobExecution 135 is finished, do nothing...

Engine Type

local

Java Version

1.8

Screenshots

No response

Are you willing to submit PR?