Performance-aware Speculative Resource Oversubscription for Large-scale Clusters

Yang, Renyu and Sun, Xiaoyang and Hu, Chunming and Garraghan, Peter and Wo, Tianyu and Wen, Zhenyu and Peng, Hao and Xu, Jie and Li, Chao (2020) Performance-aware Speculative Resource Oversubscription for Large-scale Clusters. IEEE Transactions on Parallel and Distributed Systems, 31 (7). pp. 1499-1517. ISSN 1045-9219

[thumbnail of tpds2020-rose]
Text (tpds2020-rose)
tpds2020_rose.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial.

Download (3MB)


It is a long-standing challenge to achieve a high degree of resource utilization in cluster scheduling. Resource oversubscription has become a common practice in improving resource utilization and cost reduction. However, current centralized approaches to oversubscription suffer from the issue with resource mismatch and fail to take into account other performance requirements, e.g., tail latency. In this paper we present ROSE, a new resource management platform capable of conducting performance-aware resource oversubscription. ROSE allows latency-sensitive long-running applications (LRAs) to co-exist with computation-intensive batch jobs. Instead of waiting for resource allocation to be confirmed by the centralized scheduler, job managers in ROSE can independently request to launch speculative tasks within specific machines according to their suitability for oversubscription. Node agents of those machines can however avoid any excessive resource oversubscription by means of a mechanism for admission control using multi-resource threshold control and performance-aware resource throttle. Experiments show that in case of mixed co-location of batch jobs and latency-sensitive LRAs, the CPU utilization and the disk utilization can reach 56.34% and 43.49%, respectively, but the 95th percentile of read latency in YCSB workloads only increases by 5.4% against the case of executing the LRAs alone.

Item Type:
Journal Article
Journal or Publication Title:
IEEE Transactions on Parallel and Distributed Systems
Additional Information:
©2020 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Uncontrolled Keywords:
?? resource schedulingoversubscriptioncluster utilizationresource throttlingqoshardware and architecturesoftwarecomputer networks and communicationssignal processingcomputational theory and mathematics ??
ID Code:
Deposited By:
Deposited On:
28 Jan 2020 11:20
Last Modified:
13 Jun 2024 01:37