- Research Article
- Open access
- Published:
Neural Network Adaptive Control for Discrete-Time Nonlinear Nonnegative Dynamical Systems
Advances in Difference Equations volume 2008, Article number: 868425 (2008)
Abstract
Nonnegative and compartmental dynamical system models are derived from mass and energy balance considerations that involve dynamic states whose values are nonnegative. These models are widespread in engineering and life sciences, and they typically involve the exchange of nonnegative quantities between subsystems or compartments, wherein each compartment is assumed to be kinetically homogeneous. In this paper, we develop a neuroadaptive control framework for adaptive set-point regulation of discrete-time nonlinear uncertain nonnegative and compartmental systems. The proposed framework is Lyapunov-based and guarantees ultimate boundedness of the error signals corresponding to the physical system states and the neural network weighting gains. In addition, the neuroadaptive controller guarantees that the physical system states remain in the nonnegative orthant of the state space for nonnegative initial conditions.
1. Introduction
Neural networks have provided an ideal framework for online identification and control of many complex uncertain engineering systems because of their great flexibility in approximating a large class of continuous maps and their adaptability due to their inherently parallel architecture. Even though neuroadaptive control has been applied to numerous engineering problems, neuroadaptive methods have not been widely considered for problems involving systems with nonnegative state and control constraints [1, 2]. Such systems are commonly referred to as nonnegative dynamical systems in the literature [3–8]. A subclass of nonnegative dynamical systems are compartmental systems [8–18]. Compartmental systems involve dynamical models that are characterized by conservation laws (e.g., mass and energy) capturing the exchange of material between coupled macroscopic subsystems known as compartments. The range of applications of nonnegative systems and compartmental systems includes pharmacological systems, queuing systems, stochastic systems (whose state variables represent probabilities), ecological systems, economic systems, demographic systems, telecommunications systems, and transportation systems, to cite but a few examples. Due to the severe complexities, nonlinearities, and uncertainties inherent in these systems, neural networks provide an ideal framework for online adaptive control because of their parallel processing flexibility and adaptability.
In this paper, we extend the results of [2] to develop a neuroadaptive control framework for discrete-time nonlinear uncertain nonnegative and compartmental systems. The proposed framework is Lyapunov-based and guarantees ultimate boundedness of the error signals corresponding to the physical system states as well as the neural network weighting gains. The neuroadaptive controllers are constructed without requiring knowledge of the system dynamics while guaranteeing that the physical system states remain in the nonnegative orthant of the state space. The proposed neuro control architecture is modular in the sense that if a nominal linear design model is available, the neuroadaptive controller can be augmented to the nominal design to account for system nonlinearities and system uncertainty. Furthermore, since in certain applications of nonnegative and compartmental systems (e.g., pharmacological systems for active drug administration) control (source) inputs as well as the system states need to be nonnegative, we also develop neuroadaptive controllers that guarantee the control signal as well as the physical system states remain nonnegative for nonnegative initial conditions.
The contents of the paper are as follows. In Section 2, we provide mathematical preliminaries on nonnegative dynamical systems that are necessary for developing the main results of this paper. In Section 3, we develop new Lyapunov-like theorems for partial boundedness and partial ultimate boundedness for nonlinear dynamical systems necessary for obtaining less conservative ultimate bounds for neuroadaptive controllers as compared to ultimate bounds derived using classical boundedness and ultimate boundedness notions. In Section 4, we present our main neuroadaptive control framework for adaptive set-point regulation of nonlinear uncertain nonnegative and compartmental systems. In Section 5, we extend the results of Section 4 to the case where control inputs are constrained to be nonnegative. Finally, in Section 6 we draw some conclusions.
2. Mathematical Preliminaries
In this section we introduce notation, several definitions, and some key results concerning linear and nonlinear discrete-time nonnegative dynamical systems [19] that are necessary for developing the main results of this paper. Specifically, for we write
(resp.,
) to indicate that every component of
is nonnegative (resp., positive). In this case, we say that
is nonnegative or positive, respectively. Likewise,
is nonnegative or positive if every entry of
is nonnegative or positive, respectively, which is written as
or
, respectively. In this paper it is important to distinguish between a square nonnegative (resp., positive) matrix and a nonnegative-definite (resp., positive-definite) matrix. Let
and
denote the nonnegative and positive orthants of
, that is, if
, then
and
are equivalent, respectively, to
and
. Finally, we write
to denote transpose,
for the trace operator,
(resp.,
) to denote the minimum (resp., maximum) eigenvalue of a Hermitian matrix,
for a vector norm, and
for the set of all nonnegative integers. The following definition introduces the notion of a nonnegative (resp., positive) function.
Definition 2.1.
A real function is a nonnegative (resp., positive) function if
(resp.,
),
.
The following theorems give necessary and sufficient conditions for asymptotic stability of the discrete-time linear nonnegative dynamical system
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ1_HTML.gif)
where is nonnegative and
, using linear and quadratic Lyapunov functions, respectively.
Theorem 2.2 (see [19]).
Consider the linear dynamical system given by (2.1) where
is nonnegative. Then
is asymptotically stable if and only if there exist vectors
such that
and
satisfy
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ2_HTML.gif)
Consider the linear dynamical system given by (2.1) where
is nonnegative. Then
is asymptotically stable if and only if there exist a positive diagonal matrix
and an
positive-definite matrix
such that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ3_HTML.gif)
Next, consider the controlled discrete-time linear dynamical system
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ4_HTML.gif)
where
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ5_HTML.gif)
is nonnegative and
is nonnegative such that rank
. The following theorem shows that discrete-time linear stabilizable nonnegative systems possess asymptotically stable zero dynamics with
viewed as the output. For the statement of this result, let
denote the spectrum of
, let
, and let
in (2.4) be partitioned as
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ6_HTML.gif)
where ,
,
, and
are nonnegative matrices.
Theorem 2.4.
Consider the discrete-time linear dynamical system given by (2.4), where
is nonnegative and partitioned as in (2.6), and
is nonnegative and is partitioned as in (2.5) with rank
. Then there exists a gain matrix
such that
is nonnegative and asymptotically stable if and only if
is asymptotically stable.
Proof.
First, let be partitioned as
, where
and
, and note that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ7_HTML.gif)
Assume that is nonnegative and asymptotically stable, and suppose that, ad absurdum,
is not asymptotically stable. Then, it follows from Theorem 2.2 that there does not exist a positive vector
such that
. Next, since
is nonnegative it follows that
for any positive vector
. Thus, there does not exist a positive vector
such that
, and hence, it follows from Theorem 2.2 that
is not asymptotically stable leading to a contradiction. Hence,
is asymptotically stable. Conversely, suppose that
is asymptotically stable. Then taking
and
, where
is nonnegative and asymptotically stable, it follows that
, and hence,
is nonnegative and asymptotically stable.
Next, consider the discrete-time nonlinear dynamical system
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ8_HTML.gif)
where ,
is an open subset of
with
, and
is continuous on
. Recall that the point
is an equilibrium point of (2.8) if
. Furthermore, a subset
is an invariant set with respect to (2.8) if
contains the orbits of all its points. The following definition introduces the notion of nonnegative vector fields [19].
Definition 2.5.
Let , where
is an open subset of
that contains
. Then
is nonnegative with respect to
,
, if
for all
, and
.
is nonnegative if
for all
, and
.
Note that if , where
, then
is nonnegative if and only if
is nonnegative [19].
Proposition 2.6 (see [19]).
Suppose . Then
is an invariant set with respect to (2.8) if and only if
is nonnegative.
In this paper, we consider controlled discrete-time nonlinear dynamical systems of the form
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ9_HTML.gif)
where ,
,
,
,
is continuous and satisfies
, and
is continuous.
The following definition and proposition are needed for the main results of the paper.
Definition 2.7.
The discrete-time nonlinear dynamical system given by (2.9) is nonnegative if for every and
,
, the solution
,
, to (2.9) is nonnegative.
Proposition 2.8 (see [19]).
The discrete-time nonlinear dynamical system given by (2.9) is nonnegative if and
,
.
It follows from Proposition 2.8 that a nonnegative input signal ,
, is sufficient to guarantee the nonnegativity of the state of (2.9).
Next, we present a time-varying extension to Proposition 2.8 needed for the main theorems of this paper. Specifically, we consider the time-varying system
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ10_HTML.gif)
where is continuous in
and
on
and
,
, and
is continuous. For the following result, the definition of nonnegativity holds with (2.9) replaced by (2.10).
Proposition 2.9.
Consider the time-varying discrete-time dynamical system (2.10) where is continuous on
for all
and
is continuous on
for all
. If for every
,
is nonnegative and
is nonnegative, then the solution
,
, to (2.10) is nonnegative.
Proof.
The result is a direct consequence of Proposition 2.8 by equivalently representing the time-varying discrete-time system (2.10) as an autonomous discrete-time nonlinear system by appending another state to represent time. Specifically, defining and
, it follows that the solution
,
, to (2.10) can be equivalently characterized by the solution
,
, where
, to the discrete-time nonlinear autonomous system
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ11_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ12_HTML.gif)
where . Now, since
,
, for
, and
, the result is a direct consequence of Proposition 2.8.
3. Partial Boundedness and Partial Ultimate Boundedness
In this section, we present Lyapunov-like theorems for partial boundedness and partial ultimate boundedness of discrete-time nonlinear dynamical systems. These notions allow us to develop less conservative ultimate bounds for neuroadaptive controllers as compared to ultimate bounds derived using classical boundedness and ultimate boundedness notions. Specifically, consider the discrete-time nonlinear autonomous interconnected dynamical system
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ13_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ14_HTML.gif)
where ,
is an open set such that
,
,
is such that, for every
,
and
is continuous in
, and
is continuous. Note that under the above assumptions the solution
to (3.1) and (3.2) exists and is unique over
.
Definition 3.1 (see [20]).
-
(i)
The discrete-time nonlinear dynamical system (3.1) and (3.2) is bounded with respect to
uniformly in
if there exists
such that, for every
, there exists
such that
implies
for all
. The discrete-time nonlinear dynamical system (3.1) and (3.2) is globally bounded with respect to
uniformly in
if, for every
, there exists
such that
implies
for all
.
-
(ii)
The discrete-time nonlinear dynamical system (3.1) and (3.2) is ultimately bounded with respect to  
  uniformly in  
  with ultimate bound  
  if there exists  
such that, for every
, there exists
such that
implies
,
. The discrete-time nonlinear dynamical system (3.1) and (3.2) is globally ultimately bounded with respect to  
  uniformly in  
  with ultimate bound  
if, for every
, there exists
such that
implies
,
.
Note that if a discrete-time nonlinear dynamical system is (globally) bounded with respect to uniformly in
, then there exists
such that it is (globally) ultimately bounded with respect to
uniformly in
with an ultimate bound
. Conversely, if a discrete-time nonlinear dynamical system is (globally) ultimately bounded with respect to
uniformly in
with an ultimate bound
, then it is (globally) bounded with respect to
uniformly in
. The following results present Lyapunov-like theorems for boundedness and ultimate boundedness for discrete-time nonlinear systems. For these results define
, where
and
is a given continuous function. Furthermore, let
,
,
, denote the open ball centered at
with radius
and let
denote the closure of
, and recall the definitions of class-
, class-
, and class-
functions [20].
Theorem 3.2.
Consider the discrete-time nonlinear dynamical system (3.1) and (3.2). Assume that there exist a continuous function and class-
functions
and
such that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ15_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ16_HTML.gif)
where is such that
. Furthermore, assume that
exists. Then the discrete-time nonlinear dynamical system (3.1) and (3.2) is bounded with respect to
  uniformly in  
. Furthermore, for every
,
implies that
,
, where
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ17_HTML.gif)
, and
. If, in addition,
and
is a class-
function, then the discrete-time nonlinear dynamical system (3.1) and (3.2) is globally bounded with respect to
uniformly in
and for every
,
,
, where
is given by (3.5) with
.
Proof.
See [20, page 786].
Theorem 3.3.
Consider the discrete-time nonlinear dynamical system (3.1) and (3.2). Assume there exist a continuous function and class-
functions
and
such that (3.3) holds. Furthermore, assume that there exists a continuous function
such that
,
, and
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ18_HTML.gif)
where is such that
. Finally, assume
exists. Then the nonlinear dynamical system (3.1), (3.2) is ultimately bounded with respect to
uniformly in
with ultimate bound
where
. Furthermore,
. If, in addition,
and
is a class-
function, then the nonlinear dynamical system (3.1) and (3.2) is globally ultimately bounded with respect to
uniformly in
with ultimate bound
.
Proof.
See [20, page 787].
The following result on ultimate boundedness of interconnected systems is needed for the main theorems in this paper. For this result, recall the definition of input-to-state stability given in [21].
Proposition 3.4.
Consider the discrete-time nonlinear interconnected dynamical system (3.1) and (3.2). If (3.2) is input-to-state stable with viewed as the input and (3.1) and (3.2) are ultimately bounded with respect to
uniformly in
, then the solution
,
, of the interconnected dynamical system (3.1)-(3.2), is ultimately bounded.
Proof.
Since system (3.1)-(3.2) is ultimately bounded with respect to (uniformly in
), there exist positive constants
and
such that
,
. Furthermore, since (3.2) is input-to-state stable with
viewed as the input, it follows that
is finite, and hence, there exist a class-
function
and a class-
function
such that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ19_HTML.gif)
which proves that the solution ,
to (3.1) and (3.2) is ultimately bounded.
4. Neuroadaptive Control for Discrete-Time Nonlinear Nonnegative Uncertain Systems
In this section, we consider the problem of characterizing neuroadaptive feedback control laws for discrete-time nonlinear nonnegative and compartmental uncertain dynamical systems to achieve set-point regulation in the nonnegative orthant. Specifically, consider the controlled discrete-time nonlinear uncertain dynamical system given by
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ20_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ21_HTML.gif)
where ,
, and
,
, are the state vectors,
,
, is the control input,
is nonnegative with respect to
but otherwise unknown and satisfies
,
,
is nonnegative with respect to
but otherwise unknown and satisfies
,
, and
is a known nonnegative input matrix function. Here, we assume that we have
control inputs so that the input matrix function is given by
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ22_HTML.gif)
where is a positive diagonal matrix and
is a nonnegative matrix function such that
,
. The control input
in (4.1) is restricted to the class of admissible controls consisting of measurable functions such that
,
. In this section, we do not place any restriction on the sign of the control signal and design a neuroadaptive controller that guarantees that the system states remain in the nonnegative orthant of the state space for nonnegative initial conditions and are ultimately bounded in the neighborhood of a desired equilibrium point.
In this paper, we assume that and
are unknown functions with
given by
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ23_HTML.gif)
where is a known nonnegative matrix and
is an unknown nonnegative function with respect to
and belongs to the uncertainty set
given by
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ24_HTML.gif)
where and
is an uncertain continuous function such that
is nonnegative with respect to
. Furthermore, we assume that for a given
there exist
and
such that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ25_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ26_HTML.gif)
In addition, we assume that (4.2) is input-to-state stable at with
viewed as the input, that is, there exist a class-
function
and a class-
function
such that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ27_HTML.gif)
where denotes the Euclidean vector norm. Unless otherwise stated, henceforth we use
to denote the Euclidean vector norm. Note that
is an equilibrium point of (4.1) and (4.2) if and only if there exists
such that (4.6) and (4.7) hold.
Furthermore, we assume that, for a given , the
th component of the vector function
can be approximated over a compact set
by a linear in the parameters neural network up to a desired accuracy so that for
, there exists
such that
,
, and
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ28_HTML.gif)
where ,
, are optimal unknown (constant) weights that minimize the approximation error over
,
,
, are a set of basis functions such that each component of
takes values between 0 and 1,
,
, are the modeling errors, and
, where
,
, are bounds for the optimal weights
,
.
Since is continuous, we can choose
,
, from a linear space
of continuous functions that forms an algebra and separates points in
. In this case, it follows from the Stone-Weierstrass theorem [22, page 212] that
is a dense subset of the set of continuous functions on
. Now, as is the case in the standard neuroadaptive control literature [23], we can construct the signal
involving the estimates of the optimal weights as our adaptive control signal. However, even though
,
, provides adaptive cancellation of the system uncertainty, it does not necessarily guarantee that the state trajectory of the closed-loop system remains in the nonnegative orthant of the state space for nonnegative initial conditions.
To ensure nonnegativity of the closed-loop plant states, the adaptive control signal is assumed to be of the form ,
, where
is such that each component of
takes values between 0 and 1 and
, whenever
for all
,
, where
and
are the
th element of
and
, respectively. This set of functions do not generate an algebra in
, and hence, if used as an approximator for
,
, will generate additional conservatism in the ultimate bound guarantees provided by the neural network controller. In particular, since each component of
and
takes values between 0 and 1, it follows that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ29_HTML.gif)
This upper bound is used in the proof of Theorem 4.1 below.
For the remainder of the paper we assume that there exists a gain matrix such that
is nonnegative and asymptotically stable, where
and
have the forms of (2.6) and (2.5), respectively. Now, partitioning the state in (4.1) as
, where
and
, and using (4.3), it follows that (4.1) and (4.2) can be written as
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ30_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ31_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ32_HTML.gif)
Thus, since is nonnegative and asymptotically stable, it follows from Theorem 2.4 that the solution
of (4.12) with
, where
and
satisfy
, is globally exponentially stable, and hence, (4.12) is input-to-state stable at
with
viewed as the input. Thus, in this paper we assume that the dynamics (4.12) can be included in (4.2) so that
. In this case, the input matrix (4.3) is given by
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ33_HTML.gif)
so that . Now, for a given desired set point
and for some
, our aim is to design a control input
,
, such that
and
for all
, where
, and
and
,
, for all
. However, since in many applications of nonnegative systems and, in particular, compartmental systems, it is often necessary to regulate a subset of the nonnegative state variables which usually include a central compartment, here we only require that
,
.
Theorem 4.1.
Consider the discrete-time nonlinear uncertain dynamical system given by (4.1) and (4.2) where
and
are given by (4.4) and (4.14), respectively,
is nonnegative with respect to
,
is nonnegative with respect to
, and
is nonnegative with respect to
and belongs to
. For a given
assume there exist nonnegative vectors
and
such that (4.6) and (4.7) hold. Furthermore, assume that (4.2) is input-to-state stable at
with
viewed as the input. Finally, let
be such that
is nonnegative and
is nonnegative and asymptotically stable. Then the neuroadaptive feedback control law
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ34_HTML.gif)
where
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ35_HTML.gif)
,
,
, and
with
whenever
,
,
,—with update law
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ36_HTML.gif)
where satisfies
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ37_HTML.gif)
for positive definite ,
and
are positive constants satisfying
and
,
, and
—guarantees that there exists a positively invariant set
such that
, where
, and the solution
,
, of the closed-loop system given by (4.1), (4.2), (4.15), and (4.17) is ultimately bounded for all
with ultimate bound
,
, where
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ38_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ39_HTML.gif)
,
,
,
, and
and
are positive constants satisfying
and
, respectively. Furthermore,
and
,
, for all
.
Proof.
See Appendix A.
A block diagram showing the neuroadaptive control architecture given in Theorem 4.1 is shown in Figure 1. It is important to note that the adaptive control law (4.15) and (4.17) does not require the explicit knowledge of the optimal weighting matrix and constants
and
. All that is required is the existence of the nonnegative vectors
and
such that the equilibrium conditions (4.6), and (4.7) hold. Furthermore, in the case where
is an unknown positive diagonal matrix but
,
, where
is known, we can take the gain matrix
to be diagonal so that
, where
is such that
,
. In this case, taking
in (4.4) to be the identity matrix,
is given by
which is clearly nonnegative and asymptotically stable, and hence, any positive diagonal matrix
satisfies (4.18). Finally, it is important to note that the control input signal
,
, in Theorem 4.1 can be negative depending on the values of
,
. However, as is required for nonnegative and compartmental dynamical systems the closed-loop plant states remain nonnegative.
Next, we generalize Theorem 4.1 to the case where the input matrix is not necessarily nonnegative. For this result denotes the
th row of
.
Theorem 4.2.
Consider the discrete-time nonlinear uncertain dynamical system given by (4.1) and (4.2), where
and
are given by (4.4) and (4.14), respectively,
is nonnegative with respect to
,
is nonnegative with respect to
, and
is nonnegative with respect to
and belongs to
. For a given
, assume there exist a nonnegative vector
and a vector
such that (4.6) and (4.7) hold with
. Furthermore, assume that (4.2) is input-to-state stable at
with
viewed as the input. Finally, let
be such that
,
, and
is nonnegative and asymptotically stable. Then the neuroadaptive feedback control law (4.15), where
is given by (4.16) with
,
,
, and
with
whenever
,
,
,—with update law
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ40_HTML.gif)
where satisfies (4.18),
and
are positive constants satisfying
and
,
,
—guarantees that there exists a positively invariant set
such that
, where
, and the solution
,
, of the closed-loop system given by (4.1), (4.2), (4.15), and (4.21) is ultimately bounded for all
with ultimate bound
,
, where
is given by (4.19) with
replaced by
in
and
,
. Furthermore,
and
,
, for all
.
Proof.
The proof is identical to the proof of Theorem 4.1 with replaced by
.
Finally, in the case where is an unknown diagonal matrix but the sign of each diagonal element is known and
,
, where
is known, we can take the gain matrix
to be diagonal so that
, where
is such that
,
. In this case, taking
in (4.4) to be the identity matrix,
is given by
which is nonnegative and asymptotically stable.
Example 4.3.
Consider the nonlinear uncertain system (4.1) with
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ41_HTML.gif)
where are unknown. For simplicity of exposition, here we assume that there is no internal dynamics. Note that
and
in (4.22) can be written in the form of (4.4) and (4.3) with
,
,
, and
. Furthermore, note that
is unknown and belongs to
. Since for
there exists
such that (4.6) is satisfied, it follows from Theorem 4.2 that the neuroadaptive feedback control law (4.15) with
and update law (4.21) guarantees that the closed-loop systems trajectory is ultimately bounded and remains in the nonnegative orthant of the state space for nonnegative initial conditions. With
,
,
,
,
,
, and initial conditions
and
, Figure 2 shows the state trajectories versus time and the control signal versus time.
5. Neuroadaptive Control for Discrete-Time Nonlinear Nonnegative Uncertain Systems with Nonnegative Control
As discussed in the introduction, control (source) inputs of drug delivery systems for physiological and pharmacological processes are usually constrained to be nonnegative as are the system states. Hence, in this section we develop neuroadaptive control laws for discrete-time nonnegative systems with nonnegative control inputs. In general, unlike linear nonnegative systems with asymptotically stable plant dynamics, a given set point for a discrete-time nonlinear nonnegative dynamical system
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ42_HTML.gif)
where ,
, and
, may not be asymptotically stabilizable with a constant control
. Hence, we assume that the set point
satisfying
is a unique equilibrium point in the nonnegative orthant with
and is also asymptotically stable for all
. This implies that the equilibrium solution
to (5.1) with
is asymptotically stable for all
.
In this section, we assume that in (4.4) is nonnegative and asymptotically stable, and hence, without loss of generality (see [19, Proposition 3.1]), we can assume that
is an asymptotically stable compartmental matrix [19]. Furthermore, we assume that the control inputs are injected directly into
separate compartments so that
and
in (4.14) are such that
is a positive diagonal matrix and
, where
,
, is a known positive diagonal matrix function. For compartmental systems, this assumption is not restrictive since control inputs correspond to control inflows to each individual compartment. For the statement of the next theorem, recall the definitions of
and
,
, given in Theorem 4.1.
Theorem 5.1.
Consider the discrete-time nonlinear uncertain dynamical system given by (4.1) and (4.2), where
and
are given by (4.4) and (4.14), respectively,
is nonnegative and asymptotically stable,
is nonnegative with respect to
,
is nonnegative with respect to
, and
is nonnegative with respect to
and belongs to
. For a given
assume there exist positive vectors
and
such that (4.6) and (4.7) hold and the set point
is asymptotically stable with constant control
for all
. In addition, assume that (4.2) is input-to-state stable at
with
viewed as the input. Then the neuroadaptive feedback control law
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ43_HTML.gif)
where
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ44_HTML.gif)
and ,
,
,—with update law
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ45_HTML.gif)
where satisfies
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ46_HTML.gif)
for positive definite ,
and
are positive constants satisfying
and
,
,
—guarantees that there exists a positively invariant set
such that
and the solution
,
, of the closed-loop system given by (4.1), (4.2), (5.2), and (5.4) is ultimately bounded for all
with ultimate bound
,
, where
,
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ47_HTML.gif)
,
,
,
, and
and
are positive constants satisfying
and
. Furthermore,
,
, and
,
, for all
.
Proof.
See Appendix B.
6. Conclusion
In this paper, we developed a neuroadaptive control framework for adaptive set-point regulation of discrete-time nonlinear uncertain nonnegative and compartmental systems. Using Lyapunov methods, the proposed framework was shown to guarantee ultimate boundedness of the error signals corresponding to the physical system states and the neural network weighting gains while additionally guaranteeing the nonnegativity of the closed-loop system states associated with the plant dynamics.
References
Hayakawa T, Haddad WM, Bailey JM, Hovakimyan N: Passivity-based neural network adaptive output feedback control for nonlinear nonnegative dynamical systems. IEEE Transactions on Neural Networks 2005, 16(2):387-398. 10.1109/TNN.2004.841782
Hayakawa T, Haddad WM, Hovakimyan N, Chellaboina V: Neural network adaptive control for nonlinear nonnegative dynamical systems. IEEE Transactions on Neural Networks 2005, 16(2):399-413. 10.1109/TNN.2004.841791
Berman A, Plemmons RJ: Nonnegative Matrices in the Mathematical Sciences. Academic Press, New York, NY, USA; 1979:xviii+316.
Berman A, Neumann M, Stern RJ: Nonnegative Matrices in Dynamic Systems, Pure and Applied Mathematics. John Wiley & Sons, New York, NY, USA; 1989:xxii+167.
Farina L, Rinaldi S: Positive Linear Systems: Theory and Application, Pure and Applied Mathematics. John Wiley & Sons, New York, NY, USA; 2000:x+305.
Kaszkurewicz E, Bhaya A: Matrix Diagonal Stability in Systems and Computation. Birkhäuser, Boston, Mass, USA; 2000:xiv+267.
Kaczorek T: Positive 1D and 2D Systems. Springer, London, UK; 2002.
Haddad WM, Chellaboina V: Stability and dissipativity theory for nonnegative dynamical systems: a unified analysis framework for biological and physiological systems. Nonlinear Analysis: Real World Applications 2005, 6(1):35-65. 10.1016/j.nonrwa.2004.01.006
Mohler RR: Biological modeling with variable compartmental structure. IEEE Transactions on Automatic Control 1974, 19(6):922-926. 10.1109/TAC.1974.1100739
Maeda H, Kodama S, Kajiya F: Compartmental system analysis: realization of a class of linear systems with physical constraints. IEEE Transactions on Circuits and Systems 1977, 24(1):8-14. 10.1109/TCS.1977.1084267
Sandberg IW: On the mathematical foundations of compartmental analysis in biology, medicine, and ecology. IEEE Transactions on Circuits and Systems 1978, 25(5):273-279. 10.1109/TCS.1978.1084473
Maeda H, Kodama S, Ohta Y: Asymptotic behavior of nonlinear compartmental systems: nonoscillation and stability. IEEE Transactions on Circuits and Systems 1978, 25(6):372-378. 10.1109/TCS.1978.1084490
Funderlic RE, Mankin JB: Solution of homogeneous systems of linear equations arising from compartmental models. SIAM Journal on Scientific and Statistical Computing 1981, 2(4):375-383. 10.1137/0902030
Anderson DH: Compartmental Modeling and Tracer Kinetics, Lecture Notes in Biomathematics. Volume 50. Springer, Berlin, Germany; 1983:vii+302.
Godfrey K: Compartmental Models and Their Application. Academic Press, London, UK; 1983:xiv+293.
Jacquez JA: Compartmental Analysis in Biology and Medicine. University of Michigan Press, Ann Arbor, Mich, USA; 1985.
Bernstein DS, Hyland DC: Compartmental modeling and second-moment analysis of state space systems. SIAM Journal on Matrix Analysis and Applications 1993, 14(3):880-901. 10.1137/0614060
Jacquez JA, Simon CP: Qualitative theory of compartmental systems. SIAM Review 1993, 35(1):43-79. 10.1137/1035003
Haddad WM, Chellaboina V, August E: Stability and dissipativity theory for discrete-time non-negative and compartmental dynamical systems. International Journal of Control 2003, 76(18):1845-1861. 10.1080/00207170310001635400
Haddad WM, Chellaboina V: Nonlinear Dynamical Systems and Control: A Lyapunov-Based Approach. Princeton University Press, Princeton, NJ, USA; 2008.
Jiang Z-P, Wang Y: Input-to-state stability for discrete-time nonlinear systems. Automatica 2001, 37(6):857-869. 10.1016/S0005-1098(01)00028-0
Royden HL: Real Analysis. 3rd edition. Macmillan, New York, NY, USA; 1988:xx+444.
Lewis FL, Jagannathan S, Yesildirak A: Neural Network Control of Robot Manipulators and Nonlinear Systems. Taylor & Francis, London, UK; 1999.
Acknowledgments
This research was supported in part by the Air Force Office of Scientific Research under Grant no. FA9550-06-1-0240 and the National Science Foundation under Grant no. ECS-0601311.
Author information
Authors and Affiliations
Corresponding author
Appendices
A. Proof of Theorem 4.1
In this appendix, we prove Theorem 4.1. First, note that with ,
, given by (4.15), it follows from (4.1), (4.4), and (4.14) that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ48_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ48_HTML.gif)
Now, defining and
, using (4.5)–(4.7), (4.9), and
, it follows from (4.2) and (A.1) that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ49_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ49_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ50_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ50_HTML.gif)
where ,
,
,
,
, and
. Furthermore, since
is nonnegative and asymptotically stable, it follows from Theorem 2.3 that there exist a positive diagonal matrix
and a positive-definite matrix
such that (4.18) holds.
Next, to show that the closed-loop system given by (4.17), (A.2), and (A.3) is ultimately bounded with respect to , consider the Lyapunov-like function
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ51_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ51_HTML.gif)
where . Note that (A.4) satisfies (3.3) with
,
,
, where
. Furthermore,
is a class-
function. Now, using (4.17) and (A.2), it follows that the difference of
along the closed-loop system trajectories is given by
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ52_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ52_HTML.gif)
Next, using
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ53_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ53_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ54_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ54_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ55_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ55_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ56_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ56_HTML.gif)
it follows that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ57_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ57_HTML.gif)
Furthermore, note that since, by assumption, and
,
, it follows that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ58_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ58_HTML.gif)
Hence,
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ59_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ59_HTML.gif)
Now, for
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ60_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ60_HTML.gif)
it follows that for all
, that is,
for all
and
, where
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ61_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ61_HTML.gif)
Furthermore, it follows from (A.12) that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ62_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ62_HTML.gif)
Hence, it follows from (A.4) and (A.15) that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ63_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ63_HTML.gif)
where . Thus, it follows from Theorem 3.2 that the closed-loop system given by (4.17), (A.2), and (A.3) is globally bounded with respect to
uniformly in
, and for every
,
,
, where
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ64_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ64_HTML.gif)
, and
. Furthermore, to show that
,
, suppose there exists
such that
for all
. In this case,
,
, which implies
,
. Alternatively, suppose there does not exist
such that
for all
. In this case, there exists an infinite set
. Now, with (A.13) satisfied, it follows that
for all
, that is,
for all
and
, where
is given by (A.14). Furthermore, note that
,
, and (A.16) holds. Hence, it follows from Theorem 3.3 that the closed-loop system given by (4.17), (A.2), and (A.3) is globally ultimately bounded with respect to
uniformly in
with ultimate bound given by
, where
.
Next, to show ultimate boundedness of the error dynamics, consider the Lyapunov-like function
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ65_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ65_HTML.gif)
Note that (A.18) satisfies
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ66_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ66_HTML.gif)
with ,
,
,
, and
, where
. Furthermore,
is a class-
function. Now, using (4.18), (A.10), and the definition of
, it follows that the difference of
along the closed-loop system trajectories is given by
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ67_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ67_HTML.gif)
where in (A.20) we used and
for
and
. Now, noting
and
, using the inequalities
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ68_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ68_HTML.gif)
and rearranging terms in (A.20) yields
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ69_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ69_HTML.gif)
Now, for
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ70_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ70_HTML.gif)
it follows that for all
, where
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ71_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ71_HTML.gif)
or, equivalently, for all
,
, where (see Figure 3)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ72_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ72_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ73_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ73_HTML.gif)
Next, we show that ,
. Since
for all
, it follows that, for
,
,
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ74_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ74_HTML.gif)
Now, let and assume
. If
,
, then it follows that
,
. Alternatively, if there exists
such that
, then, since
, it follows that there exists
, such that
and
, where
. Hence, it follows that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ75_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ75_HTML.gif)
which implies that . Next, let
, where
and assume
and
. Now, for every
such that
,
, it follows that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ76_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ76_HTML.gif)
which implies that ,
. Now, if there exists
such that
, then it follows as in the earlier case shown above that
,
. Hence, if
, then
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ77_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ77_HTML.gif)
Finally, repeating the above arguments with ,
, replaced by
,
, it can be shown that
,
, where
.
Figure 3
Visualization of sets used in the proof of Theorem 4. 1.
Next, define
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ78_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ78_HTML.gif)
where is the maximum value such that
, and define
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ79_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ79_HTML.gif)
where is given by (A.30). Assume that
(see Figure 3) (this assumption is standard in the neural network literature and ensures that in the error space
there exists at least one Lyapunov level set
. In the case where the neural network approximation holds in
, this assumption is automatically satisfied. See Remark A.1 for further details). Now, for all
,
. Alternatively, for all
,
. Hence, it follows that
is positively invariant. In addition, since (A.3) is input-to-state stable with
viewed as the input, it follows from Proposition 3.4 that the solution
,
, to (A.3) is ultimately bounded. Furthermore, it follows from [21, Theorem 1] that there exist a continuous, radially unbounded, positive-definite function
, a class-
function
, and a class-
function
such that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ80_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ80_HTML.gif)
Since the upper bound for is given by
, it follows that the set given by
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ81_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ81_HTML.gif)
is also positively invariant as long as (see Remark A.1). Now, since
and
are positively invariant, it follows that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ82_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ82_HTML.gif)
is also positively invariant. In addition, since (4.1), (4.2), (4.15), and (4.17) are ultimately bounded with respect to and since (4.2) is input-to-state stable at
with
viewed as the input then it follows from Proposition 3.4 that the solution
,
, of the closed-loop system (4.1), (4.2), (4.15), and (4.17) is ultimately bounded for all
.
Finally, to show that and
,
, for all
note that the closed-loop system (4.1), (4.15), and (4.17), is given by
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ83_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ83_HTML.gif)
where
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ84_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ84_HTML.gif)
Note that and
are nonnegative and, since
whenever
,
,
,
. Hence, since
is nonnegative with respect to
pointwise-in-time,
is nonnegative with respect to
, and
, it follows from Proposition 2.9 that
,
, and
,
, for all
.
Remark A.1.
In the case where the neural network approximation holds in , the assumptions
and
invoked in the proof of Theorem 4.1 are automatically satisfied. Furthermore, in this case the control law (4.15) ensures global ultimate boundedness of the error signals. However, the existence of a global neural network approximator for an uncertain nonlinear map cannot in general be established. Hence, as is common in the neural network literature, for a given arbitrarily large compact set
, we assume that there exists an approximator for the unknown nonlinear map up to a desired accuracy. Furthermore, we assume that in the error space
there exists at least one Lyapunov level set such that
. In the case where
is continuous on
, it follows from the Stone-Weierstrass theorem that
can be approximated over an arbitrarily large compact set
. In this case, our neuroadaptive controller guarantees semiglobal ultimate boundedness. An identical assumption is made in the proof of Theorem 5.1.
B. Proof of Theorem 5.1
In this appendix, we prove Theorem 5.1. First, define , where
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ85_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ85_HTML.gif)
Next, note that with ,
, given by (5.2), it follows from (4.1), (4.4), and (4.14) that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ86_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ86_HTML.gif)
Now, defining and
and using (4.6), (4.7), and 4.9), it follows from (4.2) and (B.2) that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ87_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ87_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ88_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ88_HTML.gif)
where , and
. Furthermore, since
is nonnegative and asymptotically stable, it follows from Theorem 2.3 that there exist a positive diagonal matrix
and a positive-definite matrix
such that (5.5) holds.
Next, to show ultimate boundedness of the closed-loop system (5.4), (B.3), and (B.4), consider the Lyapunov-like function
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ89_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ89_HTML.gif)
where and
with
. Note that (B.5) satisfies (3.3) with
,
,
, where
. Furthermore,
is a class-
function. Now, using (5.4) and (B.3), it follows that the difference of
along the closed-loop system trajectories is given by
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ90_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ90_HTML.gif)
Now, for each and for the two cases given in (B.1), the right-hand side of (B.6) gives the following:
-
(1)
if
, then
. Now, using (A.8), (A.9), and the inequalities
(B.7)(B.8)(B.9)(B.10)it follows that
(B.11) -
(2)
otherwise,
, and hence, using (A.8), (A.9), (B.7), (B.9), and (B.10), it follows that
(B.12)
Hence, it follows from (B.6) that in either case
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ97_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ97_HTML.gif)
Furthermore, note that since, by assumption, and
,
,
, it follows that
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ98_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ98_HTML.gif)
Hence,
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ99_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ99_HTML.gif)
Now, it follows using similar arguments as in the proof of Theorem 4.1 that the closed-loop system (5.4), (B.3), and (B.4) is globally bounded with respect to uniformly in
. If there does not exist
such that
for all
, it follows using similar arguments as in the proof of Theorem 4.1 that the closed-loop system (5.4), (B.3), and (B.4) is globally ultimately bounded with respect to
uniformly in
with ultimate bound given by
, where
. Alternatively, if there exists
such that
for all
, then
for all
.
Next, to show ultimate boundedness of the error dynamics, consider the Lyapunov-like function
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ100_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ100_HTML.gif)
Note that (B.16) satisfies (A.19) with ,
,
,
, and
, where
Furthermore,
is a class-
function. Now, using (5.5), (B.13), and the definition of
, it follows that the forward difference of
along the closed-loop system trajectories is given by
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ101_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ101_HTML.gif)
where once again in (B.17) we used and
for
and
.
Next, using (A.21) and (B.17) yields
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ102_HTML.gif)
![](http://media.springernature.com/full/springer-static/image/art%3A10.1155%2F2008%2F868425/MediaObjects/13662_2008_Article_1157_Equ102_HTML.gif)
Now, using similar arguments as in the proof of Theorem 4.1 it follows that the solution , of the closed-loop system (5.4), (B.3), and (B.4) is ultimately bounded for all
given by (A.35) and
for
.
Finally, , is a restatement of (5.2). Now, since
, and
, it follows from Proposition 2.8 that
and
, for all
.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Haddad, W.M., Chellaboina, V., Hui, Q. et al. Neural Network Adaptive Control for Discrete-Time Nonlinear Nonnegative Dynamical Systems. Adv Differ Equ 2008, 868425 (2008). https://doi.org/10.1155/2008/868425
Received:
Accepted:
Published:
DOI: https://doi.org/10.1155/2008/868425