[X] I had searched in the issues and found no similar feature requirement.
Purpose
Aliyun EMR Serverless Spark is a cloud-native, fully-managed serverless product designed specifically for large-scale data processing and analysis. It provides enterprises with a one-stop data platform service, including task development, debugging, scheduling, and operations maintenance, which greatly simplifies the entire data processing lifecycle. By using EMR Serverless Spark, enterprises can focus more on data processing and analysis, thus improving work efficiency.
This proposal aims to provide the DolphinScheduler community users with an out-of-box plugin which they could use to conveniently interact with Aliyun EMR Serverless Spark.
Environment for Manual Testing
Aliyun EMR Serverless Spark is currently in public beta and free to use until the end of 25th, June, 2024. I have added detailed documents with examples in the Issue & PR. Reviewers / Users interested in this plugin could test it free of charge.
Maintenance
I will fix any known bugs / security vulnerabilities directly related to Aliyun Serverless Spark task plugin.
I will submit a test report for Aliyun Serverless Spark task plugin every time before a new DolphinScheduler release to make sure the plugin functions well.
The community could retire this plugin if test report not received before release for three consecutive times.
Search before asking
Purpose
Environment for Manual Testing
Maintenance
Detailed Examples
Submit Jar tasks
Submit SQL tasks
Submit SQL tasks located in OSS
Submit PySpark Tasks
Are you willing to submit a PR?
Code of Conduct