search

WeBankFinTech / DataSphereStudio

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
https://github.com/WeBankFinTech/DataSphereStudio-Doc
Apache License 2.0
3.08k stars 1k forks source link

Support Using Apache Airflow as DSS Scheduler #272

Open sparklezzz opened 3 years ago

sparklezzz commented 3 years ago
  1. We've introduced a new Appjoint component, i.e dss-airflow-scheduler-appjoint, to allow DataSphereStudio to use Apache Airflow as its scheduling tools.
  2. We've introduced linkis-airflow-client, a new DSS plugin, so that Apache Airflow can run Linkis or Appjoint jobs.
  1. 开发了专门针对airflow调度工具的Appjoint组件dss-airflow-scheduler-appjoint，以允许DataSphereStudio使用Airflow作为调度工具
  2. 开发了组件linkis airflow client，来让Airflow运行Linkis或Appjoint相关任务。

Please see #273 for more details.

kuixiang commented 5 months ago

感觉这个事儿挺靠谱的，官方为啥一直没回应...