meta-soul / MetaSpore

A unified end-to-end machine intelligence platform
Apache License 2.0
642 stars 118 forks source link

Metasporeflow dag sort (#228) #229

Closed Hades-888 closed 1 year ago

Hades-888 commented 1 year ago

update sort by dag key in metasporeflow (#228)

example:

scheduler.yaml:

apiVersion: metaspore/v1
kind: OfflineCrontabScheduler
metadata:
  name: offline_crontab_scheduler
spec:
  cronExpr: "* */1 * * *"
  dag:
    join_data: [ "train_model_pop" ]
    sync_data: [ "join_data" ]

dag nodes before: ['join_data', 'train_model_pop', 'sync_data']

dag nodes after: ['sync_data', 'train_model_pop', 'join_data']