1.as shown in the picture"evaluator" is for inference job ,and the "runtime" is giant:
2.in the paper(MLaaS in the Wild: Workload Analysis and Scheduling
in Large-Scale Heterogeneous GPU Clusters),Figure 4a,the taskrun time is also begin 10s
inference job such as Image classification do not need 10s, so, there is no any such job in the cluster? and what is the job consume so much time ?
1.as shown in the picture"evaluator" is for inference job ,and the "runtime" is giant:
2.in the paper(MLaaS in the Wild: Workload Analysis and Scheduling
in Large-Scale Heterogeneous GPU Clusters),Figure 4a,the taskrun time is also begin 10s
inference job such as Image classification do not need 10s, so, there is no any such job in the cluster? and what is the job consume so much time ?
thank you very much!