search

cuebook / CueObserve

Timeseries Anomaly detection and Root Cause Analysis on data in SQL data warehouses and databases
https://cueobserve.cuebook.ai
Apache License 2.0
225 stars 23 forks source link

Auto-scale anomaly detection & RCA infra from/to Zero #136

Open sachinkbansal opened 3 years ago

sachinkbansal commented 3 years ago

Discussed in https://github.com/cuebook/CueObserve/discussions/135

Originally posted by **sdepablos** September 15, 2021 Right now CueObserve is using Celery to schedule tasks (plus Redis to save the config). This requires having the system always up for the scheduler to work. In my case, I'd prefer to run this as an "scale to 0" application, either via Cloud Run or App Engine. To that effect, my idea would be to define to schedule in Google Cloud Scheduler, which will then trigger the recalculation, without the need to have a system always up. Which would be the API endpoint to trigger a task?
itsmesrds commented 3 years ago

It's actually good to split dependent services as individual containers and scale accordingly in a containerized environment.