search

tusharchou / local-data-platform

python library for iceberg lake house on your local
MIT License
8 stars 5 forks source link

0.1.3 Orchestration using cron #44

Open brmhastra opened 1 month ago

brmhastra commented 1 month ago

Source - #27

The Problem - In the absence of an automated task scheduler like cron, essential tasks that need to run periodically, such as data pulls and backups, log file rotations, or system health checks will have to be triggered manually.

tusharchou commented 1 month ago

50

tusharchou commented 1 month ago

@brmhastra Thank you for raising a PR but lets first take some time to explain to the community why CRON is useful feature and after development how it will work

tusharchou commented 2 weeks ago

@brmhastra we have to demo how to automate google colab notebook with local data platform