apache / seatunnel

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
https://seatunnel.apache.org/
Apache License 2.0
7.81k stars 1.76k forks source link

Seatunnel Vs (DataX, Canal, flume) #1242

Open tmljob opened 2 years ago

tmljob commented 2 years ago

Search before asking

Description

Due to various acquisition requirements, our acquisition framework plans to integrate DataX, canal, and flume, but I have seen that seatunnel supports integrated streaming and batch processing. Is it possible to use seatunnel without integrating other frameworks(DataX, Canal, flume).

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

Code of Conduct

yx91490 commented 2 years ago

SeaTunnel doesn't depend on DataX, Canal or flume, it depends on spark or flink.

tmljob commented 2 years ago

SeaTunnel doesn't depend on DataX, Canal or flume, it depends on spark or flink.

I'm not referring to dependencies, but functionally whether Seatunnel can cover DataX, Canal, flume. Because we are now doing the selection of data acquisition framework, if possible, then only choose Seatunnel.

yx91490 commented 2 years ago

SeaTunnel doesn't depend on DataX, Canal or flume, it depends on spark or flink.

I'm not referring to dependencies, but functionally whether Seatunnel can cover DataX, Canal, flume. Because we are now doing the selection of data acquisition framework, if possible, then only choose Seatunnel.

you can't

tmljob commented 2 years ago

SeaTunnel doesn't depend on DataX, Canal or flume, it depends on spark or flink.

I'm not referring to dependencies, but functionally whether Seatunnel can cover DataX, Canal, flume. Because we are now doing the selection of data acquisition framework, if possible, then only choose Seatunnel.

you can't

Why?Cloud you tell me the detail cause?Thanks

yx91490 commented 2 years ago

SeaTunnel doesn't depend on DataX, Canal or flume, it depends on spark or flink.

I'm not referring to dependencies, but functionally whether Seatunnel can cover DataX, Canal, flume. Because we are now doing the selection of data acquisition framework, if possible, then only choose Seatunnel.

you can't

Why?Cloud you tell me the detail cause?Thanks

welcome to contribute these features.

tmljob commented 2 years ago

SeaTunnel doesn't depend on DataX, Canal or flume, it depends on spark or flink.

I'm not referring to dependencies, but functionally whether Seatunnel can cover DataX, Canal, flume. Because we are now doing the selection of data acquisition framework, if possible, then only choose Seatunnel.

you can't

Why?Cloud you tell me the detail cause?Thanks

welcome to contribute these features.

Our company is going to choose seatunnel as our data collection platform framework. We are still in the process of getting familiar with seatunnel, and we hope to contribute to the seatunnel community when we have the opportunity in the future.

xiazhicheng commented 2 years ago

I think the question is a good question why the contributor give an irrelevant answer?

cobolbaby commented 1 month ago

Here is a comparison of several data synchronization tools for your reference. If any information is incorrect, please let me know. Thanks.

https://github.com/cobolbaby/dockerize-and-ansible/blob/master/dts/README.md