Open liunaijie opened 4 months ago
Now the checkpoint module implement the different storage config setup, like hdfs, localfile, oss, s3. https://github.com/apache/seatunnel/tree/dev/seatunnel-engine/seatunnel-engine-storage/checkpoint-storage-plugins
checkpoint module
And i also find in hive connector there also implement the different storage type config setup. and the code is different. https://github.com/apache/seatunnel/tree/dev/seatunnel-connectors-v2/connector-hive/src/main/java/org/apache/seatunnel/connectors/seatunnel/hive/storage
hive connector
Maybe we can abstract the code, unified the code, move those to an single module or place to do that.
No response
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
Search before asking
Description
Now the
checkpoint module
implement the different storage config setup, like hdfs, localfile, oss, s3. https://github.com/apache/seatunnel/tree/dev/seatunnel-engine/seatunnel-engine-storage/checkpoint-storage-pluginsAnd i also find in
hive connector
there also implement the different storage type config setup. and the code is different. https://github.com/apache/seatunnel/tree/dev/seatunnel-connectors-v2/connector-hive/src/main/java/org/apache/seatunnel/connectors/seatunnel/hive/storageMaybe we can abstract the code, unified the code, move those to an single module or place to do that.
Usage Scenario
No response
Related issues
No response
Are you willing to submit a PR?
Code of Conduct