search

d2iq-archive / serenity

Intel:Mesosphere oversubscription technologies for Apache Mesos
Other
69 stars 21 forks source link

Substract resources used by BE executors in ResourceEstimator #99

Open skonefal opened 9 years ago

skonefal commented 9 years ago

Currently, RE counts only slack from production executors (from observers/slack_resource.cpp). RE should substract BE resource usage from this value (it is currently done in estimator/serenity_estimator.cpp which is not best place to do it).

skonefal commented 9 years ago

To fully achieve desired state, we need to implement changes in: 1) Pipeline: We need to remove PR-task-pass-filter from RE pipeline, because estimator needs to know cpu usage of BE jobs. 2) Ignore New Executors filter: We need to add configuration of what kind of executors (PR/BE/both) INE filter should cut. We need this, because estimator needs current BE usage to properly count slack (and it's ok to just cut out PR tasks in this situation). 3) Serenity Estimator: Cut BE tasks cpu utilization calculation. 4) Resource Estimator: Paste BE tasks cpu utilization calculation.