Partitions instead of pygen - Githubissues

earthcube / scheduler

Scheduling approaches related to gleaner tooling

Apache License 2.0

0 stars 0 forks source link

Partitions instead of pygen #78

Closed valentinedwv closed 1 month ago

valentinedwv commented 9 months ago

Hourly, weekly, monthly 'partitions'

https://docs.dagster.io/_apidocs/partitions

I wonder if given a list of 'sources' dagster would do the 'scheduling' as partitons.

For development, run a dagster dev ... in jetbrains.

thoughts

static partitions, and would still need some attribute: https://docs.dagster.io/concepts/partitions-schedules-sensors/partitions#creating-schedules-from-partitioned-jobs

valentinedwv commented 1 month ago

Being done as #101