State-dependent adaptive dynamic programing for a class of continuous-time nonlinear systems
Abstract
The state-dependent Riccati equation (SDRE) technique can be used to solve optimal control problems for a wide class of nonlinear dynamical systems. In this method, instead of solving a complicated Hamilton-Jacobi-Bellman (HJB) equation, a state-dependent Riccati equation is solved which leads to a suboptimal control law. However, a priori model of the system must be available to apply this technique to the optimal control problem. In this paper, to solve the SDRE without using a priori model of the system, a direct adaptive suboptimal algorithm is proposed. The algorithm, named state-dependent Riccati equation adaptive dynamic programming (SDRE-ADP), is based on a reinforcement learning approach which can be implemented in an online fashion. Like the SDRE technique, the proposed SDRE-ADP can locally asymptotically stabilize the closed-loop system provided that some conditions are satisfied. Application of the proposed algorithm to an autonomous unmanned underwater vehicle (AUV) and a numerical example shows that it can be effectively applied for nonlinear systems.
Collections
- Electrical Engineering [2649 items ]
Related items
Showing items related by title, author, creator and subject.
-
Patient-Specific Seizure Detection Using Nonlinear Dynamics and Nullclines
Zabihi M.; Kiranyaz, Mustafa Serkan; Jantti V.; Lipping T.; Gabbouj M. ( Institute of Electrical and Electronics Engineers Inc. , 2020 , Article)Nonlinear dynamics has recently been extensively used to study epilepsy due to the complex nature of the neuronal systems. This study presents a novel method that characterizes the dynamic behavior of pediatric seizure ... -
Parameter estimation of biological phenomena: An unscented kalman filter approach
Meskin, Nader; Nounou, H.; Nounou, M.; Datta, A. ( IEEE , 2013 , Article)Recent advances in high-throughput technologies for biological data acquisition have spurred a broad interest in the construction of mathematical models for biological phenomena. The development of such mathematical models ... -
Model-Free Geometric Fault Detection and Isolation for Nonlinear Systems Using Koopman Operator
Bakhtiaridoust, M.; Yadegar, M.; Meskin, Nader; Noorizadeh, M. ( Institute of Electrical and Electronics Engineers Inc. , 2022 , Article)This paper presents a model-free fault detection and isolation (FDI) method for nonlinear dynamical systems using Koopman operator theory and linear geometric technique. The key idea is to obtain a Koopman-based reduced-order ...