A Bi-Objective Markov Decision Process Design Approach to Redundancy Allocation with Dynamic Maintenance for a Parallel System

Fairley, Luke and Shone, Rob and Jacko, Peter and Huang, Jefferson (2025) A Bi-Objective Markov Decision Process Design Approach to Redundancy Allocation with Dynamic Maintenance for a Parallel System. European Journal of Operational Research. ISSN 0377-2217 (In Press)

Full text not available from this repository.

Abstract

The reliability of a system can be improved by the addition of redundant elements, giving rise to the well-known redundancy allocation problem (RAP). We propose a novel extension to the RAP called the Bi-Objective Integrated Design and Dynamic Maintenance Problem (BO-IDDMP) which allows for future dynamic maintenance decisions to be incorporated. This leads to a problem with first-stage redundancy design decisions and second-stage sequential maintenance decisions under uncertainty. To the best of our knowledge, this is the first use of a continuous-time Markov Decision Process Design framework to formulate a problem with non-trivial dynamics, as well as its first use alongside bi-objective optimization. A general heuristic optimization methodology for bi-objective MDP Design problems is developed, and then applied to the BO-IDDMP. The efficiency and accuracy of our methodology are demonstrated against an exact mixed-integer linear programming solver. The heuristic is shown to be orders of magnitude faster in the majority of cases, and in only 2 out of 84 cases produces a solution that is dominated by the exact method. The inclusion of dynamic maintenance policies is shown to yield stronger and better-populated Pareto fronts, allowing more flexibility for the decision-maker. The impacts of varying parameters unique to our problem are also investigated.

Item Type:
Journal Article
Journal or Publication Title:
European Journal of Operational Research
Uncontrolled Keywords:
Research Output Funding/yes_externally_funded
Subjects:
?? yes - externally fundednomodelling and simulationmanagement science and operations researchinformation systems and management ??
ID Code:
234160
Deposited By:
Deposited On:
11 Dec 2025 09:19
Refereed?:
Yes
Published?:
In Press
Last Modified:
11 Dec 2025 09:19