Revert to auto scaling - Githubissues

harry-gibson / ee-access-tool

Earth Engine Accessibility Tool

0 stars 0 forks source link

Revert to auto scaling #9

Open harry-gibson opened 6 years ago

harry-gibson commented 6 years ago

Currently set to use basic scaling with fixed max number of instances, to get around task queue timeouts when exporting takes > 10 minutes (which it always does). Is there a way to still use auto scaling?

harry-gibson commented 6 years ago

Possibility: have the task runner complete immediately - don't keep polling, but store a taskid:email address in memcache or something. Then run a totally separate cron service every few minutes regardless of users to poll the tasks stored in memcache and see if they're done.