search

apache / seatunnel

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
https://seatunnel.apache.org/
Apache License 2.0
7.75k stars 1.73k forks source link

[Feature][Connector-V2] Support multi-table sink feature #5652

Open Hisoka-X opened 10 months ago

Hisoka-X commented 10 months ago

Search before asking

Description

Purpose

After #5395 finnished. SeaTunnel sink can implement multi-table interface, with this feature. We can aovid shuffle in zeta. We should add implement multi-table interface for all SeaTunnel sink, also need test case. Please refer Jdbc from https://github.com/apache/seatunnel/pull/5620.

Please pick connector you want to implement it!

Type Connector Contributer Status PR
Sink Console Done
Sink Assert Done
Sink Kafka
Sink Http @jackyyyyyssss
Sink Feishu
Sink Hive @FlechazoW
Sink Clickhouse @Carl-Zhou-CN
Sink ClickhouseFile
Sink Jdbc Done
Sink Kudu @Carl-Zhou-CN
Sink EmailSink
Sink HdfsFile @dengd1937
Sink LocalFile @ruanwenjun Done #5931
Sink OssFile
Sink OssJindoFile
Sink CosFile
Sink DingTalk
Sink Elasticsearch @CosmosNi
Sink IoTDB
Sink Neo4j
Sink FtpFile
Sink SftpFile
Sink Socket
Sink Redis @jackyyyyyssss
Sink DataHub
Sink Sentry
Sink MongoDB @chl-wxp
Sink S3File
Sink AmazonDynamodb
Sink Cassandra
Sink StarRocks
Sink InfluxDB @531651225
Sink GoogleFirestore @lvshaokang
Sink Tablestore
Sink Slack
Sink RabbitMQ
Sink Doris @gnehil
Sink Maxcompute
Sink S3Redshift
Sink TDengine
Sink SelectDBCloud @ic4y
Sink Hbase @BruceWong96
Sink Rocketmq
Sink Paimon @dailai

Code of Conduct

gnehil commented 10 months ago

Please assign Doris sink task to me, thx

FlechazoW commented 10 months ago

paimon\hive\cassandra please assign to me.

Carl-Zhou-CN commented 10 months ago

Please assign me kudu

Hisoka-X commented 10 months ago

paimon\hive\cassandra please assign to me.

Hi @FlechazoW , I just assign hive to you. I will assgin other to you after you create a PR for hive.

hailin0 commented 10 months ago

Please assign me kudu

@Carl-Zhou-CN Please create issue link to this comment

Carl-Zhou-CN commented 10 months ago

Please assign me kudu

@Carl-Zhou-CN Please create issue link to this comment

done

dengd1937 commented 10 months ago

Please HdfsFile sink task to me, thx

Carl-Zhou-CN commented 8 months ago

Please Clickhouse sink task to me, thx

lightzhao commented 8 months ago

kafka and pulsar also require support multi-table sink feature? What is the meaning of this?

cyd257666 commented 7 months ago

@hailin0 Please Starrocks sink task to me, thx

lvshaokang commented 7 months ago

@hailin0 Plz assign me GoogleFirestore sink task, thx

531651225 commented 7 months ago

@hailin0 InfluxDB sink task to me, thx

jackyyyyyssss commented 6 months ago

@Hisoka-X please assign me redis sink thx

jackyyyyyssss commented 6 months ago

@Hisoka-X please assign me http sink thx

UFOXD commented 2 months ago

waitting for kafka sink

CosmosNi commented 2 months ago

@Hisoka-X please assign me Elasticsearch sink thx

BruceWong96 commented 1 month ago

@Hisoka-X Please assign me Hbase sink thx.

skyoct commented 1 month ago

@Hisoka-X I would like to try DingTalk

corgy-w commented 3 weeks ago

@Hisoka-X Why is it that when I go to implement mail's multi-sink and just use from multi-interface, exec will throw Action name is duplicated: [pipeline-1 [Sink[0]-EmailSink]] ，i didn't post config because it's usual changes.

Hisoka-X commented 3 weeks ago

@Hisoka-X Why is it that when I go to implement mail's multi-sink and just use from multi-interface, exec will throw Action name is duplicated: [pipeline-1 [Sink[0]-EmailSink]] ，i didn't post config because it's usual changes.

Please create an issue for this.

corgy-w commented 3 weeks ago

Please create an issue for this.

Ok,Please assign me this case and I'll be monitoring it closely.

corgy-w commented 2 weeks ago

Ok,Please assign me this case and I'll be monitoring it closely.

@Hisoka-X #7368