search

apache / seatunnel

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
https://seatunnel.apache.org/
Apache License 2.0
8.09k stars 1.84k forks source link

[Bug] [KingBase] KingBase not support KingbaseES V008R006C008B0014 #6391

Closed zhaohuaqiao closed 9 months ago

zhaohuaqiao commented 9 months ago

Search before asking

What happened

SeaTunnel supports KingbaseES version V008R006C007B0012, but does not support version V008R006C008B0014.

SeaTunnel Version

Seatunnel 2.3.4

SeaTunnel Config

env {
  execution.parallelism = 2
  job.mode = "BATCH"
  checkpoint.interval = 10000
}
source {
  Jdbc {
        driver = "com.kingbase8.Driver"
        url = "jdbc:kingbase8://192.168.0.62:54321/iot_message?serverTimezone=GMT%2b8"
        user = "system"
        password = "pwd"
        query = "SELECT * FROM public.bns_userloguser_b"
        database = "public"
    }  
}

transform {

}

sink {
  Console {}
}

Running Command

./bin/seatunnel.sh --config ./jobs/ods_iot_hydrology_standard_nx_zxcl__32.conf -e local

Error Exception

[root@myserver91 apache-seatunnel-2.3.4]# ./bin/seatunnel.sh --config ./jobs/ods_iot_hydrology_standard_nx_zxcl__32.conf -e local
2024-02-27 10:45:47,108 WARN  [ommandArgs$MasterTypeValidator] [main] - 
******************************************************************************************
-e and --deploy-mode deprecated in 2.3.1, please use -m and --master instead of it
******************************************************************************************
二月 27, 2024 10:45:47 上午 com.hazelcast.internal.config.AbstractConfigLocator
信息: Loading configuration '/home/huitu/T-2023-LW-0192/apache-seatunnel-2.3.4/config/seatunnel.yaml' from System property 'seatunnel.config'
二月 27, 2024 10:45:47 上午 com.hazelcast.internal.config.AbstractConfigLocator
信息: Using configuration file at /home/huitu/T-2023-LW-0192/apache-seatunnel-2.3.4/config/seatunnel.yaml
二月 27, 2024 10:45:47 上午 org.apache.seatunnel.engine.common.config.SeaTunnelConfig
信息: seatunnel.home is /home/huitu/T-2023-LW-0192/apache-seatunnel-2.3.4
二月 27, 2024 10:45:47 上午 com.hazelcast.internal.config.AbstractConfigLocator
信息: Loading configuration '/home/huitu/T-2023-LW-0192/apache-seatunnel-2.3.4/config/hazelcast.yaml' from System property 'hazelcast.config'
二月 27, 2024 10:45:47 上午 com.hazelcast.internal.config.AbstractConfigLocator
信息: Using configuration file at /home/huitu/T-2023-LW-0192/apache-seatunnel-2.3.4/config/hazelcast.yaml
2024-02-27 10:45:47,551 WARN  [c.h.i.AddressPicker           ] [main] - [LOCAL] [seatunnel-904477] [5.1] You configured your member address as host name. Please be aware of that your dns can be spoofed. Make sure that your dns configurations are correct.
2024-02-27 10:45:47,551 INFO  [c.h.i.AddressPicker           ] [main] - [LOCAL] [seatunnel-904477] [5.1] Resolving domain name 'localhost' to address(es): [127.0.0.1, 0:0:0:0:0:0:0:1]
2024-02-27 10:45:47,552 INFO  [c.h.i.AddressPicker           ] [main] - [LOCAL] [seatunnel-904477] [5.1] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [localhost/127.0.0.1, localhost/0:0:0:0:0:0:0:1]
2024-02-27 10:45:47,573 INFO  [o.a.s.e.s.SeaTunnelServer     ] [main] - SeaTunnel server start...
2024-02-27 10:45:47,574 INFO  [c.h.system                    ] [main] - [localhost]:5801 [seatunnel-904477] [5.1] Based on Hazelcast IMDG version: 5.1.0 (20220228 - 21f20e7)
2024-02-27 10:45:47,574 INFO  [c.h.system                    ] [main] - [localhost]:5801 [seatunnel-904477] [5.1] Cluster name: seatunnel-904477
2024-02-27 10:45:47,574 INFO  [c.h.system                    ] [main] - [localhost]:5801 [seatunnel-904477] [5.1] 

 _____               _____                             _ 
/  ___|             |_   _|                           | |
\ `--.   ___   __ _   | |   _   _  _ __   _ __    ___ | |
 `--. \ / _ \ / _` |  | |  | | | || '_ \ | '_ \  / _ \| |
/\__/ /|  __/| (_| |  | |  | |_| || | | || | | ||  __/| |
\____/  \___| \__,_|  \_/   \__,_||_| |_||_| |_| \___||_|

2024-02-27 10:45:47,575 INFO  [c.h.system                    ] [main] - [localhost]:5801 [seatunnel-904477] [5.1] Copyright © 2021-2022 The Apache Software Foundation. Apache SeaTunnel, SeaTunnel, and its feather logo are trademarks of The Apache Software Foundation.
2024-02-27 10:45:47,575 INFO  [c.h.system                    ] [main] - [localhost]:5801 [seatunnel-904477] [5.1] Integrity Checker is disabled. Fail-fast on corrupted executables will not be performed.
To enable integrity checker do one of the following: 
  - Change member config using Java API: config.setIntegrityCheckerEnabled(true);
  - Change XML/YAML configuration property: Set hazelcast.integrity-checker.enabled to true
  - Add system property: -Dhz.integritychecker.enabled=true (for Hazelcast embedded, works only when loading config via Config.load)
  - Add environment variable: HZ_INTEGRITYCHECKER_ENABLED=true (recommended when running container image. For Hazelcast embedded, works only when loading config via Config.load)
2024-02-27 10:45:47,577 INFO  [c.h.system                    ] [main] - [localhost]:5801 [seatunnel-904477] [5.1] The Jet engine is disabled.
To enable the Jet engine on the members, do one of the following:
  - Change member config using Java API: config.getJetConfig().setEnabled(true)
  - Change XML/YAML configuration property: Set hazelcast.jet.enabled to true
  - Add system property: -Dhz.jet.enabled=true (for Hazelcast embedded, works only when loading config via Config.load)
  - Add environment variable: HZ_JET_ENABLED=true (recommended when running container image. For Hazelcast embedded, works only when loading config via Config.load)
2024-02-27 10:45:47,939 INFO  [c.h.s.security                ] [main] - [localhost]:5801 [seatunnel-904477] [5.1] Enable DEBUG/FINE log level for log category com.hazelcast.system.security  or use -Dhazelcast.security.recommendations system property to see 🔒 security recommendations and the status of current config.
2024-02-27 10:45:47,995 INFO  [c.h.i.i.Node                  ] [main] - [localhost]:5801 [seatunnel-904477] [5.1] Using TCP/IP discovery
2024-02-27 10:45:47,996 WARN  [c.h.c.CPSubsystem             ] [main] - [localhost]:5801 [seatunnel-904477] [5.1] CP Subsystem is not enabled. CP data structures will operate in UNSAFE mode! Please note that UNSAFE mode will not provide strong consistency guarantees.
二月 27, 2024 10:45:48 上午 com.hazelcast.internal.config.AbstractConfigLocator
信息: Loading configuration '/home/huitu/T-2023-LW-0192/apache-seatunnel-2.3.4/config/seatunnel.yaml' from System property 'seatunnel.config'
二月 27, 2024 10:45:48 上午 com.hazelcast.internal.config.AbstractConfigLocator
信息: Using configuration file at /home/huitu/T-2023-LW-0192/apache-seatunnel-2.3.4/config/seatunnel.yaml
二月 27, 2024 10:45:48 上午 com.hazelcast.internal.config.AbstractConfigLocator
信息: Loading configuration '/home/huitu/T-2023-LW-0192/apache-seatunnel-2.3.4/config/hazelcast.yaml' from System property 'hazelcast.config'
二月 27, 2024 10:45:48 上午 com.hazelcast.internal.config.AbstractConfigLocator
信息: Using configuration file at /home/huitu/T-2023-LW-0192/apache-seatunnel-2.3.4/config/hazelcast.yaml
2024-02-27 10:45:48,166 WARN  [o.a.s.e.s.TaskExecutionService] [pool-2-thread-1] - [localhost]:5801 [seatunnel-904477] [5.1] The Node is not ready yet, Node state STARTING,looking forward to the next scheduling
2024-02-27 10:45:48,167 INFO  [o.a.s.e.s.TaskExecutionService] [main] - [localhost]:5801 [seatunnel-904477] [5.1] Created new BusWork : 262911569
2024-02-27 10:45:48,181 WARN  [a.s.e.s.s.s.DefaultSlotService] [hz.main.seaTunnel.slotService.thread] - failed send heartbeat to resource manager, will retry later. this address: [localhost]:5801
2024-02-27 10:45:48,186 INFO  [o.a.s.e.s.CoordinatorService  ] [pool-5-thread-1] - [localhost]:5801 [seatunnel-904477] [5.1] 
***********************************************
     CoordinatorService Thread Pool Status
***********************************************
activeCount               :                   0
corePoolSize              :                   0
maximumPoolSize           :          2147483647
poolSize                  :                   0
completedTaskCount        :                   0
taskCount                 :                   0
***********************************************

2024-02-27 10:45:48,254 INFO  [c.h.i.d.Diagnostics           ] [main] - [localhost]:5801 [seatunnel-904477] [5.1] Diagnostics disabled. To enable add -Dhazelcast.diagnostics.enabled=true to the JVM arguments.
2024-02-27 10:45:48,261 INFO  [c.h.c.LifecycleService        ] [main] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5801 is STARTING
2024-02-27 10:45:48,296 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-1] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5827 is added to the blacklist.
2024-02-27 10:45:48,296 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-3] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5823 is added to the blacklist.
2024-02-27 10:45:48,296 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-2] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5821 is added to the blacklist.
2024-02-27 10:45:48,298 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-4] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5825 is added to the blacklist.
2024-02-27 10:45:48,298 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-1] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5815 is added to the blacklist.
2024-02-27 10:45:48,303 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-2] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5813 is added to the blacklist.
2024-02-27 10:45:48,303 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-2] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5819 is added to the blacklist.
2024-02-27 10:45:48,305 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-2] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5804 is added to the blacklist.
2024-02-27 10:45:48,305 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-1] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5817 is added to the blacklist.
2024-02-27 10:45:48,306 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-3] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5808 is added to the blacklist.
2024-02-27 10:45:48,306 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-4] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5810 is added to the blacklist.
2024-02-27 10:45:48,306 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-5] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5806 is added to the blacklist.
2024-02-27 10:45:48,308 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-2] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5829 is added to the blacklist.
2024-02-27 10:45:48,309 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-6] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5802 is added to the blacklist.
2024-02-27 10:45:48,312 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-2] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5822 is added to the blacklist.
2024-02-27 10:45:48,313 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-9] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5820 is added to the blacklist.
2024-02-27 10:45:48,314 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-5] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5826 is added to the blacklist.
2024-02-27 10:45:48,316 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-3] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5812 is added to the blacklist.
2024-02-27 10:45:48,317 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-5] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5824 is added to the blacklist.
2024-02-27 10:45:48,317 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-11] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5814 is added to the blacklist.
2024-02-27 10:45:48,320 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-10] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5818 is added to the blacklist.
2024-02-27 10:45:48,321 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-2] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5805 is added to the blacklist.
2024-02-27 10:45:48,322 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-12] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5828 is added to the blacklist.
2024-02-27 10:45:48,322 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-1] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5830 is added to the blacklist.
2024-02-27 10:45:48,322 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-10] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5816 is added to the blacklist.
2024-02-27 10:45:48,322 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-7] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5811 is added to the blacklist.
2024-02-27 10:45:48,322 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-4] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5809 is added to the blacklist.
2024-02-27 10:45:48,323 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-8] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5807 is added to the blacklist.
2024-02-27 10:45:48,324 INFO  [c.h.i.c.i.TcpIpJoiner         ] [hz.main.cached.thread-6] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5803 is added to the blacklist.
2024-02-27 10:45:49,326 INFO  [c.h.i.c.ClusterService        ] [main] - [localhost]:5801 [seatunnel-904477] [5.1] 

Members {size:1, ver:1} [
    Member [localhost]:5801 - 68804257-17cb-4588-9bcd-2c4a3bd2068a this
]

2024-02-27 10:45:49,335 INFO  [c.h.c.LifecycleService        ] [main] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5801 is STARTED
二月 27, 2024 10:45:49 上午 com.hazelcast.internal.config.AbstractConfigLocator
信息: Loading configuration '/home/huitu/T-2023-LW-0192/apache-seatunnel-2.3.4/config/hazelcast-client.yaml' from System property 'hazelcast.client.config'
二月 27, 2024 10:45:49 上午 com.hazelcast.internal.config.AbstractConfigLocator
信息: Using configuration file at /home/huitu/T-2023-LW-0192/apache-seatunnel-2.3.4/config/hazelcast-client.yaml
2024-02-27 10:45:49,383 INFO  [o.a.s.e.s.CoordinatorService  ] [pool-4-thread-1] - [localhost]:5801 [seatunnel-904477] [5.1] This node become a new active master node, begin init coordinator service
2024-02-27 10:45:49,411 INFO  [.c.i.s.ClientInvocationService] [main] - hz.client_1 [seatunnel-904477] [5.1] Running with 2 response threads, dynamic=true
2024-02-27 10:45:49,421 INFO  [c.h.c.LifecycleService        ] [main] - hz.client_1 [seatunnel-904477] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is STARTING
2024-02-27 10:45:49,422 INFO  [c.h.c.LifecycleService        ] [main] - hz.client_1 [seatunnel-904477] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is STARTED
2024-02-27 10:45:49,427 INFO  [.c.i.c.ClientConnectionManager] [main] - hz.client_1 [seatunnel-904477] [5.1] Trying to connect to cluster: seatunnel-904477
2024-02-27 10:45:49,428 INFO  [.c.i.c.ClientConnectionManager] [main] - hz.client_1 [seatunnel-904477] [5.1] Trying to connect to [localhost]:5801
2024-02-27 10:45:49,440 INFO  [.p.t.AuthenticationMessageTask] [hz.main.priority-generic-operation.thread-0] - [localhost]:5801 [seatunnel-904477] [5.1] Received auth from Connection[id=1, /127.0.0.1:5801->/127.0.0.1:9220, qualifier=null, endpoint=[127.0.0.1]:9220, remoteUuid=2885cad4-a179-4596-8aa4-e3821070416c, alive=true, connectionType=JVM, planeIndex=-1], successfully authenticated, clientUuid: 2885cad4-a179-4596-8aa4-e3821070416c, client name: hz.client_1, client version: 5.1
2024-02-27 10:45:49,442 INFO  [c.h.c.LifecycleService        ] [main] - hz.client_1 [seatunnel-904477] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is CLIENT_CONNECTED
2024-02-27 10:45:49,442 INFO  [.c.i.c.ClientConnectionManager] [main] - hz.client_1 [seatunnel-904477] [5.1] Authenticated with server [localhost]:5801:68804257-17cb-4588-9bcd-2c4a3bd2068a, server version: 5.1, local address: /127.0.0.1:9220
2024-02-27 10:45:49,444 INFO  [c.h.i.d.Diagnostics           ] [main] - hz.client_1 [seatunnel-904477] [5.1] Diagnostics disabled. To enable add -Dhazelcast.diagnostics.enabled=true to the JVM arguments.
2024-02-27 10:45:49,452 INFO  [c.h.c.i.s.ClientClusterService] [hz.client_1.event-8] - hz.client_1 [seatunnel-904477] [5.1] 

Members [1] {
    Member [localhost]:5801 - 68804257-17cb-4588-9bcd-2c4a3bd2068a
}

2024-02-27 10:45:49,467 INFO  [.c.i.s.ClientStatisticsService] [main] - Client statistics is enabled with period 5 seconds.
2024-02-27 10:45:49,529 INFO  [.ClientJobExecutionEnvironment] [main] - add common jar in plugins :[file:/home/huitu/T-2023-LW-0192/apache-seatunnel-2.3.4/plugins/jdbc/lib/kingbase8-8.6.0.jar, file:/home/huitu/T-2023-LW-0192/apache-seatunnel-2.3.4/plugins/KingBaseES/lib/kingbase8-8.6.0.jar]
2024-02-27 10:45:49,534 INFO  [.h.i.p.i.PartitionStateManager] [pool-4-thread-1] - [localhost]:5801 [seatunnel-904477] [5.1] Initializing cluster partition table arrangement...
2024-02-27 10:45:49,547 INFO  [o.a.s.c.s.u.ConfigBuilder     ] [main] - Loading config file from path: ./jobs/ods_iot_hydrology_standard_nx_zxcl__32.conf
2024-02-27 10:45:49,605 INFO  [o.a.s.c.s.u.ConfigShadeUtils  ] [main] - Load config shade spi: [base64]
2024-02-27 10:45:49,667 INFO  [o.a.s.c.s.u.ConfigBuilder     ] [main] - Parsed config file: 
{
    "env" : {
        "execution.parallelism" : 2,
        "job.mode" : "BATCH",
        "checkpoint.interval" : 10000
    },
    "source" : [
        {
            "password" : "Dba$.123#",
            "database" : "public",
            "driver" : "com.kingbase8.Driver",
            "query" : "SELECT * FROM public.bns_userloguser_b",
            "plugin_name" : "Jdbc",
            "user" : "system",
            "url" : "jdbc:kingbase8://192.168.0.62:54321/iot_message?serverTimezone=GMT%2b8"
        }
    ],
    "transform" : [],
    "sink" : [
        {
            "plugin_name" : "Console"
        }
    ]
}

2024-02-27 10:45:49,679 INFO  [.s.p.d.AbstractPluginDiscovery] [main] - Load SeaTunnelSink Plugin from /home/huitu/T-2023-LW-0192/apache-seatunnel-2.3.4/connectors
2024-02-27 10:45:49,684 INFO  [.s.p.d.AbstractPluginDiscovery] [main] - Discovery plugin jar for: PluginIdentifier{engineType='seatunnel', pluginType='source', pluginName='Jdbc'} at: file:/home/huitu/T-2023-LW-0192/apache-seatunnel-2.3.4/connectors/connector-jdbc-2.3.4-SNAPSHOT.jar
2024-02-27 10:45:49,684 INFO  [.s.p.d.AbstractPluginDiscovery] [main] - Discovery plugin jar for: PluginIdentifier{engineType='seatunnel', pluginType='sink', pluginName='Console'} at: file:/home/huitu/T-2023-LW-0192/apache-seatunnel-2.3.4/connectors/connector-console-2.3.4-SNAPSHOT.jar
2024-02-27 10:45:49,689 INFO  [p.MultipleTableJobConfigParser] [main] - start generating all sources.
2024-02-27 10:45:49,720 WARN  [o.a.s.c.s.j.u.JdbcCatalogUtils] [main] - Catalog not found, loading tables from jdbc directly. url : jdbc:kingbase8://192.168.0.62:54321/iot_message?serverTimezone=GMT%2b8
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
2024-02-27 10:45:50,615 INFO  [o.a.s.c.s.j.u.JdbcCatalogUtils] [main] - Loading catalog tables for jdbc : jdbc:kingbase8://192.168.0.62:54321/iot_message?serverTimezone=GMT%2b8
2024-02-27 10:45:50,654 INFO  [c.h.c.LifecycleService        ] [main] - hz.client_1 [seatunnel-904477] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is SHUTTING_DOWN
2024-02-27 10:45:50,656 INFO  [c.h.i.s.t.TcpServerConnection ] [hz.main.IO.thread-in-1] - [localhost]:5801 [seatunnel-904477] [5.1] Connection[id=1, /127.0.0.1:5801->/127.0.0.1:9220, qualifier=null, endpoint=[127.0.0.1]:9220, remoteUuid=2885cad4-a179-4596-8aa4-e3821070416c, alive=false, connectionType=JVM, planeIndex=-1] closed. Reason: Connection closed by the other side
2024-02-27 10:45:50,657 INFO  [.c.i.c.ClientConnectionManager] [main] - hz.client_1 [seatunnel-904477] [5.1] Removed connection to endpoint: [localhost]:5801:68804257-17cb-4588-9bcd-2c4a3bd2068a, connection: ClientConnection{alive=false, connectionId=1, channel=NioChannel{/127.0.0.1:9220->localhost/127.0.0.1:5801}, remoteAddress=[localhost]:5801, lastReadTime=2024-02-27 10:45:49.648, lastWriteTime=2024-02-27 10:45:49.536, closedTime=2024-02-27 10:45:50.655, connected server version=5.1}
2024-02-27 10:45:50,657 INFO  [c.h.c.LifecycleService        ] [main] - hz.client_1 [seatunnel-904477] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is CLIENT_DISCONNECTED
2024-02-27 10:45:50,658 INFO  [c.h.c.i.ClientEndpointManager ] [hz.main.event-1] - [localhost]:5801 [seatunnel-904477] [5.1] Destroying ClientEndpoint{connection=Connection[id=1, /127.0.0.1:5801->/127.0.0.1:9220, qualifier=null, endpoint=[127.0.0.1]:9220, remoteUuid=2885cad4-a179-4596-8aa4-e3821070416c, alive=false, connectionType=JVM, planeIndex=-1], clientUuid=2885cad4-a179-4596-8aa4-e3821070416c, clientName=hz.client_1, authenticated=true, clientVersion=5.1, creationTime=1709001949437, latest clientAttributes=lastStatisticsCollectionTime=1709001949467,enterprise=false,clientType=JVM,clientVersion=5.1,clusterConnectionTimestamp=1709001949429,clientAddress=127.0.0.1,clientName=hz.client_1,credentials.principal=null,os.committedVirtualMemorySize=4337623040,os.freePhysicalMemorySize=3719270400,os.freeSwapSpaceSize=8066691072,os.maxFileDescriptorCount=4096,os.openFileDescriptorCount=78,os.processCpuTime=5300000000,os.systemLoadAverage=0.1,os.totalPhysicalMemorySize=16552513536,os.totalSwapSpaceSize=8388603904,runtime.availableProcessors=4,runtime.freeMemory=234938080,runtime.maxMemory=477626368,runtime.totalMemory=284688384,runtime.uptime=2849,runtime.usedMemory=49750304, labels=[]}
2024-02-27 10:45:50,660 INFO  [c.h.c.LifecycleService        ] [main] - hz.client_1 [seatunnel-904477] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is SHUTDOWN
2024-02-27 10:45:50,660 INFO  [s.c.s.s.c.ClientExecuteCommand] [main] - Closed SeaTunnel client......
2024-02-27 10:45:50,660 INFO  [c.h.c.LifecycleService        ] [main] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5801 is SHUTTING_DOWN
2024-02-27 10:45:50,663 INFO  [c.h.i.p.i.MigrationManager    ] [hz.main.cached.thread-8] - [localhost]:5801 [seatunnel-904477] [5.1] Shutdown request of Member [localhost]:5801 - 68804257-17cb-4588-9bcd-2c4a3bd2068a this is handled
2024-02-27 10:45:50,667 INFO  [c.h.i.i.Node                  ] [main] - [localhost]:5801 [seatunnel-904477] [5.1] Shutting down connection manager...
2024-02-27 10:45:50,669 INFO  [c.h.i.i.Node                  ] [main] - [localhost]:5801 [seatunnel-904477] [5.1] Shutting down node engine...
2024-02-27 10:45:53,681 INFO  [c.h.i.i.NodeExtension         ] [main] - [localhost]:5801 [seatunnel-904477] [5.1] Destroying node NodeExtension.
2024-02-27 10:45:53,682 INFO  [c.h.i.i.Node                  ] [main] - [localhost]:5801 [seatunnel-904477] [5.1] Hazelcast Shutdown is completed in 3020 ms.
2024-02-27 10:45:53,683 INFO  [c.h.c.LifecycleService        ] [main] - [localhost]:5801 [seatunnel-904477] [5.1] [localhost]:5801 is SHUTDOWN
2024-02-27 10:45:53,683 INFO  [s.c.s.s.c.ClientExecuteCommand] [main] - Closed HazelcastInstance ......
2024-02-27 10:45:53,684 ERROR [o.a.s.c.s.SeaTunnel           ] [main] - 

===============================================================================

2024-02-27 10:45:53,684 ERROR [o.a.s.c.s.SeaTunnel           ] [main] - Fatal Error, 

2024-02-27 10:45:53,684 ERROR [o.a.s.c.s.SeaTunnel           ] [main] - Please submit bug report in https://github.com/apache/seatunnel/issues

2024-02-27 10:45:53,684 ERROR [o.a.s.c.s.SeaTunnel           ] [main] - Reason:SeaTunnel job executed failed 

2024-02-27 10:45:53,687 ERROR [o.a.s.c.s.SeaTunnel           ] [main] - Exception StackTrace:org.apache.seatunnel.core.starter.exception.CommandExecuteException: SeaTunnel job executed failed
    at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:199)
    at org.apache.seatunnel.core.starter.SeaTunnel.run(SeaTunnel.java:40)
    at org.apache.seatunnel.core.starter.seatunnel.SeaTunnelClient.main(SeaTunnelClient.java:34)
Caused by: org.apache.seatunnel.api.table.factory.FactoryException: ErrorCode:[API-06], ErrorDescription:[Factory initialize failed] - Unable to create a source for identifier 'Jdbc'.
    at org.apache.seatunnel.api.table.factory.FactoryUtil.createAndPrepareSource(FactoryUtil.java:100)
    at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parseSource(MultipleTableJobConfigParser.java:318)
    at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parse(MultipleTableJobConfigParser.java:183)
    at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.getLogicalDag(ClientJobExecutionEnvironment.java:88)
    at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.execute(ClientJobExecutionEnvironment.java:161)
    at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:146)
    ... 2 more
Caused by: org.apache.seatunnel.common.exception.SeaTunnelRuntimeException: ErrorCode:[COMMON-20], ErrorDescription:['UNKNOWN' table 'SELECT * FROM public.bns_userloguser_b' unsupported get catalog table with field data types '{"useflg":"CHAR","sex":"CHAR"}']
    at org.apache.seatunnel.common.exception.CommonError.getCatalogTableWithUnsupportedType(CommonError.java:143)
    at org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.utils.CatalogUtils.getCatalogTable(CatalogUtils.java:261)
    at org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.utils.CatalogUtils.getCatalogTable(CatalogUtils.java:227)
    at org.apache.seatunnel.connectors.seatunnel.jdbc.utils.JdbcCatalogUtils.getCatalogTable(JdbcCatalogUtils.java:351)
    at org.apache.seatunnel.connectors.seatunnel.jdbc.utils.JdbcCatalogUtils.getCatalogTable(JdbcCatalogUtils.java:344)
    at org.apache.seatunnel.connectors.seatunnel.jdbc.utils.JdbcCatalogUtils.getTables(JdbcCatalogUtils.java:128)
    at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSource.<init>(JdbcSource.java:57)
    at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceFactory.lambda$createSource$0(JdbcSourceFactory.java:78)
    at org.apache.seatunnel.api.table.factory.FactoryUtil.createAndPrepareSource(FactoryUtil.java:112)
    at org.apache.seatunnel.api.table.factory.FactoryUtil.createAndPrepareSource(FactoryUtil.java:73)
    ... 7 more

2024-02-27 10:45:53,688 ERROR [o.a.s.c.s.SeaTunnel           ] [main] - 
===============================================================================

Exception in thread "main" org.apache.seatunnel.core.starter.exception.CommandExecuteException: SeaTunnel job executed failed
    at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:199)
    at org.apache.seatunnel.core.starter.SeaTunnel.run(SeaTunnel.java:40)
    at org.apache.seatunnel.core.starter.seatunnel.SeaTunnelClient.main(SeaTunnelClient.java:34)
Caused by: org.apache.seatunnel.api.table.factory.FactoryException: ErrorCode:[API-06], ErrorDescription:[Factory initialize failed] - Unable to create a source for identifier 'Jdbc'.
    at org.apache.seatunnel.api.table.factory.FactoryUtil.createAndPrepareSource(FactoryUtil.java:100)
    at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parseSource(MultipleTableJobConfigParser.java:318)
    at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parse(MultipleTableJobConfigParser.java:183)
    at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.getLogicalDag(ClientJobExecutionEnvironment.java:88)
    at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.execute(ClientJobExecutionEnvironment.java:161)
    at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:146)
    ... 2 more
Caused by: org.apache.seatunnel.common.exception.SeaTunnelRuntimeException: ErrorCode:[COMMON-20], ErrorDescription:['UNKNOWN' table 'SELECT * FROM public.bns_userloguser_b' unsupported get catalog table with field data types '{"useflg":"CHAR","sex":"CHAR"}']
    at org.apache.seatunnel.common.exception.CommonError.getCatalogTableWithUnsupportedType(CommonError.java:143)
    at org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.utils.CatalogUtils.getCatalogTable(CatalogUtils.java:261)
    at org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.utils.CatalogUtils.getCatalogTable(CatalogUtils.java:227)
    at org.apache.seatunnel.connectors.seatunnel.jdbc.utils.JdbcCatalogUtils.getCatalogTable(JdbcCatalogUtils.java:351)
    at org.apache.seatunnel.connectors.seatunnel.jdbc.utils.JdbcCatalogUtils.getCatalogTable(JdbcCatalogUtils.java:344)
    at org.apache.seatunnel.connectors.seatunnel.jdbc.utils.JdbcCatalogUtils.getTables(JdbcCatalogUtils.java:128)
    at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSource.<init>(JdbcSource.java:57)
    at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceFactory.lambda$createSource$0(JdbcSourceFactory.java:78)
    at org.apache.seatunnel.api.table.factory.FactoryUtil.createAndPrepareSource(FactoryUtil.java:112)
    at org.apache.seatunnel.api.table.factory.FactoryUtil.createAndPrepareSource(FactoryUtil.java:73)
    ... 7 more

Zeta or Flink or Spark Version

No response

Java or Scala Version

No response

Screenshots

No response

Are you willing to submit PR?

Code of Conduct

zhaohuaqiao commented 9 months ago

The same configuration runs successfully on KingbaseES version V008R006C007B0012.

NoPr commented 7 months ago

同样的问题，已经解决。 source模块去掉query语句，直接使用table_path参数，参考JDBC Source。