Computation Offloading in Heterogeneous Vehicular Edge Networks:On-line and Off-policy Bandit Solutions

Bozorgchenani, Arash and Maghsudi, Setareh and Tarchi, Daniele and Hossain, Ekram (2021) Computation Offloading in Heterogeneous Vehicular Edge Networks:On-line and Off-policy Bandit Solutions. IEEE Transactions on Mobile Computing. ISSN 1536-1233

Text (Computation Offloading in Heterogeneous VEC, On-line and Off-policy Bandit Solutions)
Computation_Offloading_in_Heterogeneous_VEC_On_line_and_Off_policy_Bandit_Solutions.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial.

Download (1MB)


With the rapid advancement of Intelligent Transportation Systems (ITS) and vehicular communications, Vehicular Edge Computing (VEC) is emerging as a promising technology to support low-latency ITS applications and services. In this paper, we consider the computation offloading problem from mobile vehicles/users in a heterogeneous VEC scenario, and focus on the network and base station selection problems, where different networks have different traffic loads. In a fast-varying vehicular environment, computation offloading experience of users is strongly affected by the latency due to the congestion at the edge computing servers co-located with the base stations. However, as a result of the non-stationary property of such an environment and also information shortage, predicting this congestion is an involved task. To address this challenge, we propose an on-line learning algorithm and an off-policy learning algorithm based on multi-armed bandit theory. To dynamically select the least congested network in a piece-wise stationary environment, these algorithms predict the latency that the offloaded tasks experience using the offloading history. In addition, to minimize the task loss due to the mobility of the vehicles, we develop a method for base station selection. Moreover, we propose a relaying mechanism for the selected network, which operates based on the sojourn time of the vehicles. Through intensive numerical analysis, we demonstrate that the proposed learning-based solutions adapt to the traffic changes of the network by selecting the least congested network, thereby reducing the latency of offloaded tasks. Moreover, we demonstrate that the proposed joint base station selection and the relaying mechanism minimize the task loss in a vehicular environment.

Item Type:
Journal Article
Journal or Publication Title:
IEEE Transactions on Mobile Computing
Additional Information:
©2021 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Uncontrolled Keywords:
ID Code:
Deposited By:
Deposited On:
07 Jun 2021 08:55
Last Modified:
20 Jun 2021 06:15