search

collectivemedia / celos

Scriptable scheduler for periodical Hadoop workflows
Apache License 2.0
22 stars 9 forks source link

Add scheduling strategy to execute latest slot only #722

Open ashf72 opened 8 years ago

ashf72 commented 8 years ago

@manuel is it possible to add scheduling strategy that will run only the latest of ready slots and will not run the rest? This would be really useful for jobs that do not use slot datetime for data selection, like Conflux. Currently, after the failure, we have a lot of ready slots, while, in fact, only the latest is needed to resume normal operation. Thank you.

manuel commented 8 years ago

@ashf72 Yes, this is quite easy to do. I'll keep you posted.