[improve] Support third parties to quickly initiate flink tasks

[zhaoyang20201221]

Search before asking

• [X] I had searched in the feature and found no similar feature requirement.

Description

In the process of data synchronization, I want to use the streampark service to quickly start a flink task. At this time, I found that the following interfaces need to be initiated every time

• flink/app/copy
• flink/pipe/build
• flink/app/start It's a bit troublesome. I just want to call the interface once to run the flink task quickly. In this way, the development efficiency can be improved. I think streamPark needs to provide an interface that includes the above five functions. Do not expose your own business logic to the outside world and form a single responsibility to better expand third-party services.

Modify the previous interface display:

The interface display after the change：

Usage Scenario

When a third-party service uses the streamPark service, it hopes to quickly start a flink task, and does not care how the internal logic of streamPark is implemented. If the above interfaces are combined to provide an interface service, streamPark will have better scalability and applicability.

Related issues

No response

Are you willing to submit a PR?

• [X] Yes I am willing to submit a PR!

Code of Conduct

• [X] I agree to follow this project's Code of Conduct

[wolfboys]

Great proposal, This feature is very useful for third-party platform integration, Are there any more details about design and implementation?

[zhaoyang20201221]

This is a piece of pseudocode, briefly describe my implementation logic

/**
 * Quickly start a flink task
 * @param copyId  The ID of the copy task
 * @param jobName Task name
 * @param args    parameter
 * @param isDel   Whether you want to delete duplicate tasks, default value = false
 *
 * @return
 */

public Boolean quickStartFlinkTask(Long copyId ,String jobName ,String args,Boolean isDel){

  try {

      // Verify that the task name already exists
      boolean existsByJobName = applicationService.existsByJobName(jobName);

      if(existsByJobName && isDel) {
          // Get the task details through the job name
          Application app =  applicationService.getByJobName(jobName);
          // Delete the previous task
          applicationService.delete(app);
      }

      // First copy a configuration template and get the task id
      Long id = applicationService.copy(copyId,jobName,args);

      // Get task details
      Application application = applicationService.getById(id);

      // build flink task
      appBuildPipeService.buildApplication(id,false);

      // start flink task
      applicationService.start(application);
  } catch (Exception e) {
      throw new RuntimeException(e.toString());
  }

}