apache / seatunnel

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
https://seatunnel.apache.org/
Apache License 2.0
7.6k stars 1.68k forks source link

[Mongo-cdc][starrocks] 自动建表语句错误 #6880

Open bulolo opened 1 month ago

bulolo commented 1 month ago

Search before asking

What happened

自动建表语句错误

SeaTunnel Version

2.3.5

SeaTunnel Config

env {
  parallelism = 1
  job.mode = "STREAMING"
  checkpoint.interval = 5000
  read_limit.bytes_per_second=7000000
  read_limit.rows_per_second=400
}

source {
  MongoDB-CDC {
    hosts = "xxx:27011"
    database = ["biocitydb"]
    collection = ["biocitydb.suppliers"]
    username = root
    password = "xxx"
    schema = {
      fields {
        "_id" : string,
        "name" : string
      }
    }
  }
}

sink {
  StarRocks {
    nodeUrls=[
        "xxx:8040"
    ]
    batch_max_rows = 1024
    table="suppliers"
    database="scm"
    base-url="jdbc:mysql://xxx:9030"
    password="XXX"
    username="root"
    enable_upsert_delete = true
    schema_save_mode="CREATE_SCHEMA_WHEN_NOT_EXIST"
    data_save_mode="APPEND_DATA"
  }
}

Running Command

./bin/seatunnel.sh --config xxx.conf -e local

Error Exception

Caused by: org.apache.seatunnel.api.table.catalog.exception.CatalogException: ErrorCode:[API-03], ErrorDescription:[Catalog initialize failed] - Failed create table in catalog StarRocks, sql :[CREATE TABLE IF NOT EXISTS `scm`.`suppliers` (
,
`_id` STRING NULL ,
`name` STRING NULL
) ENGINE=OLAP
 PRIMARY KEY ()
DISTRIBUTED BY HASH ()PROPERTIES (
    "replication_num" = "1"
)]
github-actions[bot] commented 2 weeks ago

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.