search

boxidau / rax-autoscaler

Apache License 2.0
5 stars 2 forks source link

Performance enhancement for getting cloud monitoring metrics #4

Closed boxidau closed 9 years ago

boxidau commented 9 years ago

Single threaded operation is quite slow when gathering statistics.

Potential solution: spawn threads for each entity so metrics may be gathered in parallel

siso commented 9 years ago

Would you scale in/out depending on multiple metrics?

boxidau commented 9 years ago

Probably not. I'm referring to gathering metrics for each node in the AS group

boxidau commented 9 years ago

We should also think about putting an upper limit on the number of nodes to gather data from. Since we are calculating an average across the cluster. For example if there are 100 nodes in the AS group we can probably just sample the metric on 10 of them and still make an informed decision as to whether to scale, any more is just a waste of resources and API calls.

boxidau commented 9 years ago

@siso: As discussed we will just use the --max-sample cmd arg instead of threading