FusionCL:A Machine-Learning Based Approach for OpenCL Kernel Fusion to Increase System Performance

Khalid, Yasir Noman and Aleem, Muhammad and Ahmed, Usman and Prodan, Radu and Islam, Muhammad Arshad and Iqbal, Muhammad Azhar (2021) FusionCL:A Machine-Learning Based Approach for OpenCL Kernel Fusion to Increase System Performance. Computing, 103 (10). pp. 2171-2202. ISSN 0010-485X

Full text not available from this repository.

Abstract

Employing general-purpose graphics processing units (GPGPU) with the help of OpenCL has resulted in greatly reducing the execution time of data-parallel applications by taking advantage of the massive available parallelism. However, when a small data size application is executed on GPU there is a wastage of GPU resources as the application cannot fully utilize GPU compute-cores. There is no mechanism to share a GPU between two kernels due to the lack of operating system support on GPU. In this paper, we propose the provision of a GPU sharing mechanism between two kernels that will lead to increasing GPU occupancy, and as a result, reduce execution time of a job pool. However, if a pair of the kernel is competing for the same set of resources (i.e., both applications are compute-intensive or memory-intensive), kernel fusion may also result in a significant increase in execution time of fused kernels. Therefore, it is pertinent to select an optimal pair of kernels for fusion that will result in significant speedup over their serial execution. This research presents FusionCL, a machine learning-based GPU sharing mechanism between a pair of OpenCL kernels. FusionCL identifies each pair of kernels (from the job pool), which are suitable candidates for fusion using a machine learning-based fusion suitability classifier. Thereafter, from all the candidates, it selects a pair of candidate kernels that will produce maximum speedup after fusion over their serial execution using a fusion speedup predictor. The experimental evaluation shows that the proposed kernel fusion mechanism reduces execution time by 2.83× when compared to a baseline scheduling scheme. When compared to state-of-the-art, the reduction in execution time is up to 8%.

Item Type:
Journal Article
Journal or Publication Title:
Computing
Uncontrolled Keywords:
/dk/atira/pure/subjectarea/asjc/2600/2612
Subjects:
Departments:
ID Code:
171512
Deposited By:
Deposited On:
10 Jun 2022 11:00
Refereed?:
Yes
Published?:
Published
Last Modified:
22 Nov 2022 11:32