Saturated Output-Feedback Hybrid Reinforcement Learning Controller for Submersible Vehicles Guaranteeing Output Constraints

Elhaki, Omid and Shojaei, Khoshnam and Shanahan, Declan and Montazeri, Allahyar (2021) Saturated Output-Feedback Hybrid Reinforcement Learning Controller for Submersible Vehicles Guaranteeing Output Constraints. IEEE Access, 9. pp. 136580-136592. ISSN 2169-3536

[thumbnail of ACCESS3113080 (1)]
Text (ACCESS3113080 (1))
ACCESS3113080_1_.pdf - Accepted Version
Available under License Creative Commons Attribution.

Download (3MB)


In this brief, we propose a new neuro-fuzzy reinforcement learning-based control (NFRLC) structure that allows autonomous underwater vehicles (AUVs) to follow a desired trajectory in large-scale complex environments precisely. The accurate tracking control problem is solved by a unique online NFRLC method designed based on actor-critic (AC) structure. Integrating the NFRLC framework including an adaptive multilayer neural network (MNN) and interval type-2 fuzzy neural network (IT2FNN) with a high-gain observer (HGO), a robust smart observer-based system is set up to estimate the velocities of the AUVs, unknown dynamic parameters containing unmodeled dynamics, nonlinearities, uncertainties and external disturbances. By employing a saturation function in the design procedure and transforming the input limitations into input saturation nonlinearities, the risk of the actuator saturation is effectively reduced together with nonlinear input saturation compensation by the NFRLC strategy. A predefined funnel-shaped performance function is designed to attain certain prescribed output performance. Finally, stability study reveals that the entire closed-loop system signals are semi-globally uniformly ultimately bounded (SGUUB) and can provide prescribed convergence rate for the tracking errors so that the tracking errors approach to the origin evolving inside the funnel-shaped performance bound at the prescribed time.

Item Type:
Journal Article
Journal or Publication Title:
IEEE Access
Uncontrolled Keywords:
?? saturation functionreinforcement learningprescribed performancehigh-gain observerinterval type-2 fuzzy neural networksmultilayer neural networksengineering(all)computer science(all)materials science(all) ??
ID Code:
Deposited By:
Deposited On:
07 Oct 2021 15:35
Last Modified:
14 Jun 2024 01:25