Online Service Migration in Mobile Edge with Incomplete System Information : A Deep Recurrent Actor-Critic Learning Approach

Wang, Jin and Hu, Jia and Min, Geyong and Ni, Qiang and El-Ghazawi, Tarek (2023) Online Service Migration in Mobile Edge with Incomplete System Information : A Deep Recurrent Actor-Critic Learning Approach. IEEE Transactions on Mobile Computing, 22 (11): 11. pp. 6663-6675. ISSN 1536-1233

[thumbnail of Author-accepted-version]
Text (Author-accepted-version)
Author_accepted_version.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial.

Download (2MB)


Multi-access Edge Computing (MEC) is an emerging computing paradigm that extends cloud computing to the network edge to support resource-intensive applications on mobile devices. As a crucial problem in MEC, service migration needs to decide how to migrate user services for maintaining the Quality-of-Service when users roam between MEC servers with limited coverage and capacity. However, finding an optimal migration policy is intractable due to the dynamic MEC environment and user mobility. Many existing studies make centralized migration decisions based on complete system-level information, which is time-consuming and also lacks desirable scalability. To address these challenges, we propose a novel learning-driven method, which is user-centric and can make effective online migration decisions by utilizing incomplete system-level information. Specifically, the service migration problem is modeled as a Partially Observable Markov Decision Process (POMDP). To solve the POMDP, we design a new encoder network that combines a Long Short-Term Memory (LSTM) and an embedding matrix for effective extraction of hidden information, and further propose a tailored off-policy actor-critic algorithm for efficient training. The extensive experimental results based on real-world mobility traces demonstrate that this new method consistently outperforms both the heuristic and state-of-the-art learning-driven algorithms and can achieve near-optimal results on various MEC scenarios.

Item Type:
Journal Article
Journal or Publication Title:
IEEE Transactions on Mobile Computing
Additional Information:
©2022 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Uncontrolled Keywords:
?? bandwidthcomputational modelingdelaysmobile handsetsmulti-access edge computingquality of serviceserverstask analysisdeep reinforcement learningpartial observable markov decision processservice migrationsoftwareelectrical and electronic engineeringcompute ??
ID Code:
Deposited By:
Deposited On:
30 Aug 2022 13:20
Last Modified:
30 Nov 2023 01:59