Cloud instance management and resource prediction for computation-as-a-service platforms

Doyle, Joseph and Giotsas, Vasileios and Anam, Mohammad Ashraful and Andreopoulos, Yiannis (2016) Cloud instance management and resource prediction for computation-as-a-service platforms. In: Proceedings - 2016 IEEE International Conference on Cloud Engineering, IC2E 2016: Co-located with the 1st IEEE International Conference on Internet-of-Things Design and Implementation, IoTDI 2016 :. Institute of Electrical and Electronics Engineers Inc., DEU, pp. 89-98. ISBN 9781509019618

[thumbnail of Dithen_IC2E2016]
PDF (Dithen_IC2E2016)
1604.04804.pdf - Accepted Version

Download (1MB)


Computation-as-a-Service (CaaS) offerings have gained traction in the last few years due to their effectiveness in balancing between the scalability of Software-as-a-Service and the customisation possibilities of Infrastructure-as-a-Service platforms. To function effectively, a CaaS platform must have three key properties: (i) reactive assignment of individual processing tasks to available cloud instances (compute units) according to availability and predetermined time-to-completion (TTC) constraints, (ii) accurate resource prediction, (iii) efficient control of the number of cloud instances servicing workloads, in order to optimize between completing workloads in a timely fashion and reducing resource utilization costs. In this paper, we propose three approaches that satisfy these properties (respectively): (i) a service rate allocation mechanism based on proportional fairness and TTC constraints, (ii) Kalman-filter estimates for resource prediction, and (iii) the use of additive increase multiplicative decrease (AIMD) algorithms (famous for being the resource management in the transport control protocol) for the control of the number of compute units servicing workloads. The integration of our three proposals into a single CaaS platform is shown to provide for more than 27% reduction in Amazon EC2 spot instance cost against methods based on reactive resource prediction and 38% to 60% reduction of the billing cost against the current state-of-the-art in CaaS platforms (Amazon Lambda and Autoscale).

Item Type:
Contribution in Book/Report/Proceedings
Additional Information:
©2016 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Uncontrolled Keywords:
?? amazon ec2big datacomputation-as-a-servicemultimedia computingspot instancescontrol and systems engineeringcomputer networks and communications ??
ID Code:
Deposited By:
Deposited On:
16 Feb 2018 10:51
Last Modified:
12 May 2024 01:46