A reinforcement learning hyper-heuristic for water distribution network optimisation

Ahmed, Azza O. M. and Osman, Shahd M. Y. and Yousif, Terteel E. H. and Kheiri, Ahmed (2021) A reinforcement learning hyper-heuristic for water distribution network optimisation. In: 2020 International Conference on Computer, Control, Electrical, and Electronics Engineering (ICCCEEE). IEEE. ISBN 9781728191126

ICCCEEE20WDN.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial.

Download (396kB)


The Water Distribution Networks (WDNs) optimisation problem focuses on finding the combination of pipes from a collection of discrete sizes available to construct a network of pipes with minimum monetary cost. It is one of the most significant problems faced by WDN engineers. This problem belongs to the class of difficult combinatorial optimisation problems, whose optimal solution is hard to find, due to its large search space. Hyper-heuristics are high-level search algorithms that explore the space of heuristics rather than the space of solutions in a given optimisation problem. In this work, different selection hyper-heuristics were proposed and empirically analysed in the WDN optimisation problem, with the goal of minimising the network’s cost. New York Tunnels network benchmark was used to test the performance of these hyper-heuristics including the Reinforcement Learning (RL) hyper-heuristic method, that succeeded in achieving improved results.

Item Type:
Contribution in Book/Report/Proceedings
ID Code:
Deposited By:
Deposited On:
23 Jun 2021 09:34
Last Modified:
18 Sep 2023 02:46