Reliable computing service in massive-scale systems through rapid low-cost failover

Yang, Renyu and Zhang, Yang and Garraghan, Peter and Feng, Yihui and Ouyang, Jin and Xu, Jie and Zhang, Zhuo and Li, Chao (2017) Reliable computing service in massive-scale systems through rapid low-cost failover. IEEE Transactions on Services Computing, 10 (6). pp. 969-983. ISSN 1939-1374

[thumbnail of tsc-2016-camera-ready-v10]
PDF (tsc-2016-camera-ready-v10)
tsc_2016_camera_ready_v10.pdf - Accepted Version
Available under License Creative Commons Attribution.

Download (3MB)


Large-scale distributed systems in Cloud datacenter are capable of provisioning service to consumers with diverse business requirements. Providers face pressure to provision uninterrupted reliable services while reducing operational costs due to significant software and hardware failures. A widely used means to achieve such a goal is using redundant system components to implement usertransparent failover, yet its effectiveness must be balanced carefully without incurring heavy overhead when deployed – an important practical consideration for complex large-scale systems. Failover techniques developed for Cloud systems often suffer serious limitations, including mandatory restart leading to poor cost-effectiveness, as well as solely focusing on crash failures, omitting other important types, e.g. timing failures and simultaneous failures. This paper addresses these limitations by presenting a new approach to user-transparent failover for massive-scale systems. The approach uses soft-state inference to achieve rapid failure recovery and avoid unnecessary restart, with minimal system resource overhead. It also copes with different failures, including correlated and simultaneous events. The proposed approach was implemented, deployed and evaluated within Fuxi system, the underlying resource management system used within Alibaba Cloud. Results demonstrate that our approach tolerates complex failure scenarios while incurring at worst 228.5 microsecond instance overhead with 1.71% additional CPU usage.

Item Type:
Journal Article
Journal or Publication Title:
IEEE Transactions on Services Computing
Additional Information:
© 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.
Uncontrolled Keywords:
?? failovercloud computingresource managementreliabilityservicesinformation systems and managementcomputer science applicationshardware and architecturecomputer networks and communications ??
ID Code:
Deposited By:
Deposited On:
21 Oct 2016 10:00
Last Modified:
15 Jul 2024 16:27