- Research
- Open access
- Published:
Exponential input-to-state stability of composite stochastic systems
Advances in Difference Equations volume 2013, Article number: 208 (2013)
Abstract
Sufficient conditions for the exponential input-to-state stability in probability in r th mean and for the almost sure exponential input-to-state stability in probability of a composite stochastic system are established. Illustrating example is provided to validate our results.
MSC:60H10, 93C10, 93D05, 93D15, 93D21, 93E15.
1 Introduction
The stability of deterministic control systems has been widely developed in the past few decades (see, for instance, Sontag and Wang [1], Grune [2], Karafyllis and Tsinias [3], Ning et al. [4]). In these papers, necessary and sufficient conditions for input-to-state stability at the equilibrium state of deterministic control systems were provided. On the other hand, the asymptotic stability, exponential stability and input-to-state stability in probability at the equilibrium state of stochastic control systems (SCS) were established by Mao [5], Liu and Raffool [6], Lan and Dang [7], Abedi et al. [8, 9], Abedi and Leong [10], Khasminiskii [11], Kushner [12], Tsinias [13], Ito [14], Liu et al. [15], Duan et al. [16] and Yu and Xie [17]. Particularly, Ito [14] developed the properties of input-to-state stability and gave the design of controller by using nonlinear small-gain conditions. While Liu et al. [15] discussed the property of practical stochastic input-to-state stability and its application to stability of cascaded nonlinear systems. The concept of integral input-to-state stability to the stochastic nonlinear systems was generalized by Yu and Xie [17] and Duan et al. [16] and state feedback controller that guarantees that all the signals of the resulting closed-loop system are bounded almost surely was also given.
Michel [18] developed exponential stability in probability of a continuous and discrete parameters composite stochastic system. Later, Boulanger [19] derived sufficient conditions for asymptotic stability in probability and exponential stability in mean square for a special case of our composite stochastic control system (CSCS). The sufficient conditions for exponential stability in probability of nonlinear stochastic systems, which are the special case of our CSCS, were established by Rusinek [20].
The purpose of the paper is to fill the gaps in the literature by studying the exponential input-to-state stability in probability in r th mean (REISSP) and the almost sure exponential input-to-state stability in probability (AEISSP) of a CSCS. We take this fact into account to extend the REISSP and AEISSP results established by Spiliotis and Tsinias [21] for SCS to the broader class of CSCS driven by two independent Wiener processes that were considered in Boulanger [19] and Rusinek [20]. The main results of our work enable us to derive sufficient conditions for REISSP and AEISSP of the CSCS. We also establish the existence of an explicit formula for a feedback law exhibiting the REISSP and AEISSP property.
The rest of the paper is organized as follows. In Section 2, we introduce a wider class of CSCS and we also recall some basic definitions and results relating the REISSP and AEISSP property. Finally in Section 3, we use the results of Section 2 and prove that the CSCS satisfies the REISSP and AEISSP property. We also provide a numerical example to illustrate our results.
2 Assumptions and preliminaries
The aim of this section is to introduce a class of stochastic differential systems (SDS) and recall some basic definitions and theorems concerning an exponential control Lyapunov function for the exponential stability in probability of this system that we are dealing with in the rest of the paper. We also focus on the properties of the exponential control Lyapunov function, which plays an important role in the exponential stability, in Section 3.
Let be a complete probability space, and denote by a standard -valued Wiener process defined on this space.
Consider the multi-input SDS in
where the state space is , f and h are Lipschitz functionals mapping from into and , respectively, vanishing at the origin and there exists a nonnegative constant C such that for any , the following growth condition holds:
Assume that for a function ,
is the infinitesimal generator for the stochastic process solution of SDS (1). Then we can recall the definition of exponential stability in probability in mean square and the stochastic version of the converse Lyapunov theorem established by Khasminskii [11] as follows.
Definition 2.1 We say that the origin is exponentially stable in probability in mean square with respect to SDS (1) if and only if there exist constants such that
Theorem 2.2 Suppose that the origin is exponentially stable in probability in mean square with respect to SDS (1). Then there exist a Lyapunov function and positive constants , , such that
where ∇ is the gradient operator and D is given in (3).
Assume that is a standard -valued Wiener process defined on a complete probability space . Now, consider the multi-input SCS in
where the state space is and the following conditions hold:
-
(1)
u is an -valued measurable control law,
-
(2)
F and G are Lipschitz functionals mapping from into , and , respectively, such that they are vanishing at the origin and there exists constant such that for any and , the following growth condition holds:
(8)
Under restriction on growth (8) (see, for instance, Arnold [22]), for every input , and , there exists a unique solution of (7) starting from at time which is defined for all and almost all . In the following we assume and we recall the definition of RESP, AESP and the stochastic version of the converse Lyapunov theorem proved by Spiliotis and Tsinias [21] as follows.
Definition 2.3 We say that the origin is RESP with respect to SCS (7) for some if and only if there exist constants such that
Definition 2.4 SCS (7) is said to satisfy the exponential Lyapunov condition if there exists a Lyapunov function of class and positive constants , , such that
where Y is the infinitesimal generator for the stochastic process solution of SCS (7).
Theorem 2.5 Suppose that the origin is RESP with respect to SCS (7). Then there exists a Lyapunov function of class which satisfies all conditions (10)-(12).
Definition 2.6 We say that the origin is AESP with respect to SCS (7) if and only if there exist a constant and a random variable such that
Note that Definition 2.3 and Theorem 2.5 in Spiliotis and Tsinias [21] are an extension of Definition 2.1 and Theorem 2.2, respectively, established in Khasminskii [11]. Now, we recall the definition of REISSP and AEISSP exposed in [21] as follows.
Definition 2.7 We say that the origin is REISSP with respect to SCS (7) if there exist a positive definite function and constants such that (9) holds and
Definition 2.8 We say that the origin is AEISSP with respect to SCS (7) if, there exist a positive definite function , constant , and a random variable such that (13) and (14) hold for any , and .
We shall now turn the attention to a broader class of CSCS and provide some results related to the REISSP and AEISSP of this system.
Let us first introduce a general composite stochastic system.
Assume that is a standard -valued Wiener process defined on a complete probability space independent of a standard -valued Wiener process . Consider the multi-input CSCS
where the following conditions hold:
(H1) , , and D is a matrix function with value in ,
(H2) f and h are functionals in and , respectively, such that ,
(H3) and are Lipschitz functionals such that there exists a nondecreasing scalar function bounded for all Ï… such that
(H4) u is an -valued measurable control law,
(H5) and are Lipschitz functionals, vanishing at the origin and there exists a nonnegative constant C such that the following growth condition holds:
Suppose that there exist functionals , , and such that
and
for any . Then CSCS (15) is rewritten as
By considering the results on EISSP exposed in [21], we can establish the following outcome.
Lemma 2.9 CSCS (17) satisfies the REISSP and AEISSP property if and only if is RESP and AESP, respectively, for the system
where .
Proof The proof of this lemma is a direct consequence of Definitions 2.3, 2.6-2.8 and the fact that each solution of (18) that corresponds to some coincides with the solution of (17) with the same initial , and and corresponding to , namely, satisfying (14). Conversely, each solution of (17) under restriction (14) is a solution of (18) with input and the same initial value. □
In the next section we establish the state feedback law that guarantees the satisfaction of the REISSP and AEISSP property for CSCS (17).
3 Main stability results
The REISSP and AEISSP results proved in this paper employ the technique which is a combination of those by Sontag and Wang [1, 23], i.e., decomposition for a deterministic control system, and Spiliotis and Tsinias [21], i.e., decomposition in stochastic case for the SCS. We use these decompositions to obtain the existing exponential stability results for the CSCS. In the following theorem, we assume that the functions g and q are bounded on and U is the set of admissible control. To establish sufficient conditions for REISSP and AEISSP of CSCS (17), we use Lemma 2.9 and show that the origin is RESP and AESP for CSCS (18). Theorem 3.1 can be viewed as a stochastic extension of Proposition 4.1 and Theorem 4.1 stated in Spiliotis and Tsinias [21] and Boulanger [19], respectively, to a general composite stochastic system. Both the results and the tools used in this theorem, however, are different from those in [19, 21]. Furthermore, we can consider the exponential stability results of Boulanger [19] as a special case of our REISSP results (Theorem 3.1) where .
Theorem 3.1 Consider CSCS (17). Assume that the function is positive definite with bounded first derivative , and for all , there exists a function Φ satisfying the exponential Lyapunov condition. Furthermore, assume that
Then the state control law
where is a smooth Lyapunov function corresponding to SDS (1) and is a state control law corresponding to the resulting closed-loop system deduced from (16), renders CSCS (17) satisfying the REISSP and AEISSP property.
Proof For the proof of this theorem, we shall use Lemma 2.9 and show that REISSP and AISSP are satisfied for CSCS (17) if and only if the origin is RESP and AESP for CSCS (18). Assume that the function satisfies the exponential Lyapunov condition with respect to CSCS (17). Obviously, by our hypothesis, the function satisfies the exponential Lyapunov condition with respect to CSCS (18). We now show that the origin satisfies RESP and AESP for CSCS (18). First we prove that the equilibrium of CSCS (18) is satisfied in the RESP property. Since the exponential Lyapunov condition is fulfilled for CSCS (18), there exists a Lyapunov function and positive constants , , such that (10)-(12) hold. Consider the composite function
where and are the Lyapunov functions corresponding to SDS (1) and SCS (16), respectively. By substituting into the closed-loop system deduced from CSCS (18), we have
Denoting as the infinitesimal generator of the stochastic process solution of the resulting closed-loop system (22), we obtain
for any . Substituting (19) into (23), we get
Then, from (12) and (24), we get
Hence, the desired condition (9) is a direct consequence of inequalities (10) and (25). Therefore, CSCS (18) satisfies the RESP property at the origin. It turns out by Lemma 2.9 that CSCS (17) satisfies the REISSP property.
Finally, suppose that there exists a positive composite function
such that CSCS (18) satisfies the exponential Lyapunov condition. Then, by taking into account (10)-(12), (23), (19) and (26), we obtain
From (26)-(27) and the fact , we have is a supermartingale. Therefore, for some random , it yields
From (28) we have for all , almost surely, for some random . The latter in conjunction with (10), (25) and (26) implies (13). Thus, CSCS (18) satisfies the AESP property at the origin. It turns out by Lemma 2.9 that CSCS (17) will also satisfy the AEISSP property, which completes the proof. □
The following proposition (Proposition 3.2) is a stochastic extension of Proposition 4.2 stated in Spiliotis and Tsinias [21] to a general composite stochastic system.
Proposition 3.2 Consider CSCS (17). Assume that conditions (H1)-(H5) hold and the origin is RESP with zero input (namely, (9) holds with ). Then REISSP holds for certain linear positive definite function , where, for some linear function ,
Proof Suppose that the origin of CSCS (17) satisfies the RESP property. From (24) it turns out, by the converse Lyapunov theorem (Theorem 2.5), that there exist positive constants , , and such that conditions (10)-(11) hold and
where D, , are the infinitesimal generators for the stochastic process solutions of systems (1), (16), (22), respectively, and , , are the Lyapunov functions corresponding to the systems (1), (16), (22), respectively. It then follows from (29) that
for some positive constant k and certain , . The rest of the proof is a consequence of Theorem 3.1 and is, therefore, omitted. □
Remark 3.3 Comparing our main results to the existing ones in [19–21], we can make the following summaries:
-
(i)
Theorem 3.1 is the stochastic extension of Proposition 4.1 and Theorem 4.1 stated in Spiliotis and Tsinias [21] and Boulanger [19], respectively, to a general composite stochastic system. Both the results and the tools used in this theorem, however, are different from those in [19, 21]. Furthermore, we can consider the exponential stability results of Boulanger [19] as a special case of our REISSP results (Theorem 3.1) where .
-
(ii)
Proposition 3.2 is the stochastic extension of Proposition 4.2 stated in Spiliotis and Tsinias [21] to a general composite stochastic system. In addition, the existing exponential stability results established in [19, 20] and [21] do not permit us to make a conclusion about REISSP and AEISSP for the broader class of CSCS (15) at the origin, whereas the results of this paper are still valid.
Finally, we conclude the paper by designing a numerical example to validate our results.
Example 3.4 Consider the CSCS
where and are two independent standard real-valued Wiener processes, , u is a real-valued measurable control law, and is the identity matrix in . Consider the Lyapunov function candidate
A simple calculation shows that satisfies the exponential Lyapunov condition and
is the state control law corresponding to the resulting closed-loop system deduced from
where
and , , , . (For more information about the state control law , one can refer to Theorem 3.2 established by Abedi et al. [8].) Then, according to Theorem 3.1, the state control law
guarantees that CSCS (30) satisfies the REISSP and AEISSP property.
4 Conclusions
We have developed the exponential input-to-state stability in probability of a larger class of multi-input composite system (15). We have used the stochastic version of converse Lyapunov theorems derived by Khasminiskii [11] and Spiliotis and Tsinias [21] to the concept of stochastic control Lyapunov function and extended the REISSP and the AEISSP results provided by Spiliotis and Tsinias [21] for a stochastic system to the larger class of composite stochastic systems driven by two independent Wiener processes that were considered in Boulanger [19] and Rusinek [20]. The main results of our work enable us to derive the sufficient conditions for REISSP and AEISSP of a composite stochastic system. We have also established the existence of an explicit formula of a feedback law exhibiting the REISSP and AEISSP property of a composite stochastic system.
References
Sontag DE, Wang Y: Lyapunov characterizations of input to output stability. SIAM J. Control Optim. 2000, 39(1):351-359.
Grune L: Input-to-state dynamical stability and its Lyapunov characterization. IEEE Trans. Autom. Control 2002, 47(9):1499-1504. 10.1109/TAC.2002.802761
Karafyllis I, Tsinias J: A converse Lyapunov theorem for nonuniform in time global asymptotic stability and its application to feedback stabilization. SIAM J. Control Optim. 2003, 42: 936-965. 10.1137/S0363012901392967
Ning C, He Y, Wu M, Liu Q, She J: Input-to-state stability of nonlinear systems based on an indefinite Lyapunov function. Syst. Control Lett. 2012, 61: 1254-1259. 10.1016/j.sysconle.2012.08.009
Mao X: Exponential Stability of Stochastic Differential Equations. Dekker, New York; 1994.
Liu R, Raffoul Y: Boundedness and exponential stability of highly nonlinear stochastic differential equations. Electron. J. Differ. Equ. 2009., 2009: Article ID 143
Lan TTT, Dang NH: Exponential stability of nontrivial solutions of stochastic differential equations. Scientia, Ser. A, Math. Sci. 2011, 21: 97-106.
Abedi F, Abu Hassan M, Arifin MN: Lyapunov function for nonuniform in time global asymptotic stability in probability with application to feedback stabilization. Acta Appl. Math. 2011, 116(1):107-117. 10.1007/s10440-011-9632-8
Abedi F, Abu Hassan M, Suleiman M: Feedback stabilization and adaptive stabilization of stochastic nonlinear systems by the control Lyapunov function. Stoch. Int. J. Probab. Stoch. Process. 2011, 83(2):179-201. 10.1080/17442508.2011.552723
Abedi F, Leong JW: Dynamic robust stabilization of stochastic differential control systems. IMA J. Math. Control Inf. 2013. 10.1093/imamci/dns040
Khasminskii ZR: Stochastic Stability of Differential Equation. Sijthoff & Noordhoff, Alphen aan den Rijn; 1980.
Kushner JH: On the stability of processes defined by stochastic difference-differential equation. J. Differ. Equ. 1968, 4: 424-443. 10.1016/0022-0396(68)90028-4
Tsinias J: Stochastic input-to-state stability and applications to global feedback stabilization. Int. J. Control 1998, 71: 907-931. 10.1080/002071798221632
Ito H: State-dependent scaling problems and stability of interconnected iISS and ISS systems. IEEE Trans. Autom. Control 2006, 51(10):1626-1643. 10.1109/TAC.2006.882930
Liu SJ, Zhang JF, Jiang ZP: A notion of stochastic input-to-state stability and its application to stability of cascaded stochastic nonlinear systems. Acta Math. Appl. Sin. 2008, 24(1):141-156. 10.1007/s10255-007-7005-x
Duan N, Xie XJ, Yu X: State feedback stabilization of stochastic nonlinear systems with SiISS inverse dynamics. Int. J. Robust Nonlinear Control 2011, 21: 1903-1919. 10.1002/rnc.1677
Yu X, Xie XJ: Output feedback regulation of stochastic nonlinear systems with stochastic iISS inverse dynamics. IEEE Trans. Autom. Control 2010, 55(2):304-320.
Michel NA: Stability analysis of stochastic composite systems. IEEE Trans. Autom. Control 1975, 20(2):246-250. 10.1109/TAC.1975.1100903
Boulanger C: Stabilization of a class of nonlinear composite stochastic systems. Stoch. Anal. Appl. 2000, 18(5):723-735. 10.1080/07362990008809694
Rusinek RL: String stability of singularly perturbed stochastic systems. Ann. Math. Sil. 2003, 16: 43-55.
Spiliotis J, Tsinias J: Notions of exponential robust stochastic stability, ISS and their Lyapunov characterizations. Int. J. Robust Nonlinear Control 2003, 13: 173-187. 10.1002/rnc.724
Arnold L: Stochastic Differential Equations: Theory and Applications. Wiley, New York; 1974.
Sontag DE, Wang Y: On characterizations of input-to-state stability properties. Syst. Control Lett. 1995, 24: 226-231.
Acknowledgements
The authors thank the referees for valuable comments and suggestions which improved the presentation of this manuscript.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
All authors read and approved the final manuscript.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Abedi, F., Leong, W.J. & Seddighi Chaharborj, S. Exponential input-to-state stability of composite stochastic systems. Adv Differ Equ 2013, 208 (2013). https://doi.org/10.1186/1687-1847-2013-208
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1687-1847-2013-208