search

apache / seatunnel

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
https://seatunnel.apache.org/
Apache License 2.0
7.92k stars 1.79k forks source link

SeaTunnel community meeting Topic collect #7004

Closed hailin0 closed 4 months ago

hailin0 commented 4 months ago

Search before asking

Description

hailin0 invites you to a meeting on Tencent Meeting Meeting Topic: SeaTunnel Community Meeting Time: 2024/06/18 20:00-21:00 (GMT+08:00) China Standard Time - Beijing

Click the link to join the meeting or to add it to your meeting list: https://meeting.tencent.com/dm/b9NY8konvBkY

TencentMeeting: 589-770-828

Copy this invitation and open in Tencent Meeting app (V2.13 or later) to join the meeting Everyone is very welcome to join: If you have an issue, please submit it one day before the meeting, and provide a specific issue link and context.

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

Code of Conduct

hailin0 commented 4 months ago

@Hisoka-X

hailin0 commented 4 months ago

@hailin0

hailin0 commented 4 months ago

@dailai

hailin0 commented 4 months ago

@EricJoy2048

zhang5059T commented 4 months ago

Hi could talk about the supported Spark versions of Seatunnel on Spark? Recently, I was submitting the Seatunnel project using Spark-operator and found that it threw a type conversion exception.

spark version

3.3.0

seatunnel version

2.3.5

scala version

2.12.15

spark-operator

v1beta2-1.3.3-3.3.0

Exception

cannot assign instance of scala.collection.immutable.List$SerializationProxy to field org.apache.spark.rdd.RDD.dependencies_ of type scala.collection.Seq in instance of org.apache.spark.rdd.MapPartitionsRDD

trhlxc commented 4 months ago

1.sqlserver2doris,Table fields are named using keywords, hope to provide solutions

CREATE TABLE iplant.dbo.test (
    item varchar(50) COLLATE Chinese_PRC_CI_AI NOT NULL,
    createdate datetime NULL,
    createby varchar(50) COLLATE Chinese_PRC_CI_AI NULL,
    [date] datetime NULL,
    CONSTRAINT PK_test PRIMARY KEY (item)
);

2.https://github.com/apache/seatunnel/issues/6957

laixueyong commented 4 months ago

Web的数据集成的转换与处理的sql功能 总是报找不到source中的表 3264995dbb65099422b8a6974113e05 4151812e48a78770fbd9a77ec2d0722 a495bb2bb74ab241b899d70358d0125

Hisoka-X commented 4 months ago

Web的数据集成的转换与处理的sql功能 总是报找不到source中的表 3264995dbb65099422b8a6974113e05 4151812e48a78770fbd9a77ec2d0722 a495bb2bb74ab241b899d70358d0125

https://github.com/apache/seatunnel/pull/7020