A notion of stability in probability of stochastic nonlinear systems
Advances in Difference Equations volume 2013, Article number: 363 (2013)
The concepts of stability in probability of nontrivial solutions for stochastic nonlinear systems are analyzed in terms of a control Lyapunov function which is smooth except possibly at the origin. We show under certain hypothesis that the neighborhood of the origin is stable in probability. An illustrating example is provided.
MSC:60H10, 93C10, 93D05, 93D15, 93D21, 93E15.
In recent years, the stability analysis of stochastic nonlinear systems (SNS) has been one of the most active and important areas in control theory. Although there are many research papers (see, for instance, [1–13]) on the stability of trivial solutions of SNS, but there are very few results on the stability of nontrivial solutions of stochastic systems. It is known that there are many types of stochastic systems all of whose solutions tend to each other although they do not have the trivial solution. These systems are worth being interested in since the solutions with different initial value has similar large-time properties. In this paper, we study the stability in probability of a nontrivial solution of the SNS.
The main results of the present paper is to explore further the stabilization in probability problem for a wider class of SNS than that described in . This paper is also intended to fill in the gap of the previous works by establishing necessary and sufficient conditions for stability in probability of nontrivial solution for the SNS. Our main result, Theorem 3.1, which is an extension of Theorem 3.1 established in , asserts that the SNS is stable in probability if and only if it admits a control Lyapunov function (CLF). The main tool used in this paper is a stochastic version of the converse Lyapunov theorem established in Kushner .
The paper is organized as follows. In Section 2, we introduce a class of stochastic systems, some basic definitions and properties of stochastic CLF which play an important role in the stability theory. In Section 3, we state and prove the main results of the paper on the stability in probability of nontrivial solution of SNS. Finally, in Section 4, we provide a numerical example to validate our results.
2 Stochastic stability
In this section we first introduce a class of stochastic systems and define the stability in probability of nontrivial solutions of this system. We also focus on the properties of CLF which play an important role to the stability in Section 3.
Let be a complete probability space, and denote by a standard -valued Wiener process defined on this space.
Consider the following SNS
where is the system state vector, and are continuous with , , and there exist constants such that the following conditions hold:
We note that SNS (1) satisfies a sufficient condition, under which there is some unique global solution to SNS (1) for any given initial value (see, for instance, Khasminskii ).
Throughout this paper we adopt the following notations:
For any , denote by the solution of SNS (1).
Denote by the usual Euclidean norm in .
We use to denote the initial value of a Lyapunov function.
denotes the class of nonnegative functions , for which and hold.
is a ball.
We define .
Definition 2.1 A function is a
K-function if it is continuous, strictly increasing and , and
-function if it is a K-function and also as .
We now give the definition of stability in probability for SNS (1) when the origin is not a trivial solution. In this case we study the stability in probability of solutions with respect to the small neighborhood of the origin.
Definition 2.2 We say that , is stable in probability if for any and any , there exists such that for all and , the following condition holds:
In the following we consider the SNS
where , , the dynamics , and , are continuous and Lipschitz functions with and .
Theorem 3.1 of this paper is an extension of Theorem 3.1 provided in  that guarantees the existence of a control law in such a way that satisfy the stability in probability property with respect to the closed-loop system
Denote by D the infinitesimal generator of the stochastic process solution of the uncontrolled part of SNS (3), that is, D is the second-order differential operator defined for any function Φ in by
For any , denote by the first-order differential operator defined for any function Φ in by
Define Y as the infinitesimal generator for the stochastic process solution of the closed-loop system (4), that is, Y is the differential operator defined for any function Φ in by
In the following we extend the concept of stochastic Lyapunov condition introduced in Definition 2.4 provided in  used for stability in probability of SNS (3) at the neighborhood of the origin.
Definition 2.3 SNS (3) admits a CLF if there exists a function , class functions , , a positive definite function , and a nonnegative function μ of class such that for all , the following conditions hold:
Remark 2.4 We note that condition (6) obtained in Definition 2.3 can be replaced with the following condition
In the next section we will turn the attention to the class of SNS (3) and provide some results related to the stability in probability of this system.
3 Main results
In this section, where the dynamics and may be non-vanishing at the origin, we study the stability in probability of nontrivial solutions of SNS (3). In the following theorem that is an extension of Theorem 3.1 established in , we derive the necessary and sufficient conditions for stability in probability of nontrivial solutions of SNS (3).
Theorem 3.1 Consider SNS (3). Then the following three statements are equivalent:
There exists a control law with for all such that satisfy the stability in probability property with respect to closed-loop system (4).
There exists a control law with for all , being locally Lipschitz in x, in such a way that satisfy the stability in probability property with respect to closed-loop system (4).
There exists a function , class functions , , a positive definite function , and a nonnegative function μ of class such that for all , conditions (5) and (6) hold.
Proof The implication (i) → (ii) is obvious.
We should establish the implication (ii) → (iii). Suppose that there exists a control law (as in statement (ii) of the theorem) such that satisfies the stability in probability with respect to the closed-loop system (4). Then, by the converse Lyapunov theorem (Theorem 2) developed by Kushner , which proved the existence of a stochastic Lyapunov function in some neighborhood of the origin, there exists a Lyapunov function Φ in and a continuous and positive definite function in such a way that (5) holds and
where Y is the infinitesimal generator for the stochastic process solution of closed-loop system (4). The latter inequality implies (6) with , and . Therefore, Definition 2.3 holds and the Lyapunov function is a stochastic CLF for SNS (3).
Next, for (iii) → (i), suppose that there exists a function such that both conditions (5) and (6) are fulfilled with respect to closed-loop system (4). Without any loss of generality, assume
Notice, by virtue of (5), that
Then using (5) and (6) and by applying the converse result of Theorem 3.1 established in , condition (6) in conjunction with (8) and (9) enables us to build, by the standard partition of unity arguments, a control law with such that
From (10) and , we have that is a supermartingale. Let and . Invoking Ito’s formula for SNS (3), we get
With (10) and (11) we have
From (12) we obtain
Assume that there exists a nonnegative function μ of class such that
for all . Taking into account (10) and (13)-(14) yields
Let for a given , there exist , , such that for and , the following inequality holds
We note that if . So,
Then, by taking into account (5) and (17), we have
Thus, from (15)-(16) and (18), we have
The latter inequality implies that
Letting , we obtain
This implies that for given and , there exists such that
for all and . Therefore, from (20) and Definition 2.2, is stable in probability with respect to closed-loop system (4). This completes the proof of Theorem 3.1. □
In this section we illustrate our results by designing a numerical example.
Example 4.1 Consider the SNS
where is a standard real-valued Wiener process, u is a real-valued measurable control law, , , , , , and .
Define the Lyapunov function in the form
A simple calculation shows that
From (22) we have , and so , , , and .
Thus, we get
The latter inequality implies that both (5) and (6) are fulfilled with , , and , and thus, by Theorem 3.1, there exists a -feedback law with such that is stable in probability with respect to the resulting closed-loop system deduced from (21).
Many authors have paid attention to the subject of stability in probability of trivial solutions of stochastic systems in the past years. On the other hand, it is known that there are many types of stochastic systems all of whose solutions tend to each other although they do not have the trivial solution. In this paper, we have established the stability in probability of nontrivial solutions for SNS (3). We have derived a stochastic version of CLF and provided the necessary and sufficient conditions for stability in probability of a nontrivial solution for SNS (3).
Abedi F, Abu Hassan M, Suleiman M: Feedback stabilization and adaptive stabilization of stochastic nonlinear systems by the control Lyapunov function. Stoch. Int. J. Probab. Stoch. Process. 2011, 83(2):179-201. 10.1080/17442508.2011.552723
Abedi F, Abu Hassan M, Arifin MN: Lyapunov function for nonuniform in time global asymptotic stability in probability with application to feedback stabilization. Acta Appl. Math. 2011, 116(1):107-117. 10.1007/s10440-011-9632-8
Abedi F, Leong JW: Dynamic robust stabilization of stochastic differential control systems. IMA J. Math. Control Inf. 2013, 30(4):559-569. 10.1093/imamci/dns040
Chen W, Jiao CL: Finite-time stability theorem of stochastic nonlinear systems. Automatica 2010, 46: 2105-2108. 10.1016/j.automatica.2010.08.009
Deng H, Krstic M, Williams JR: Stabilization of stochastic nonlinear systems driven by noise of unknown covariance. IEEE Trans. Autom. Control 2001, 46(8):1237-1253. 10.1109/9.940927
Florchinger P: Lyapunov-like techniques for stochastic stability. SIAM J. Control Optim. 1995, 33: 1151-1169. 10.1137/S0363012993252309
Handel VR: Almost global stochastic stability. SIAM J. Control Optim. 2006, 45: 1297-1313. 10.1137/040618850
Khasminskii ZR: Stochastic Stability of Differential Equation. Sijthoff & Noordhoff, Alphen aan den Rijn; 1980.
Kushner JH: Converse theorems for stochastic Lyapunov functions. SIAM J. Control Optim. 1967, 5: 228-233. 10.1137/0305015
Lin Z, Liu J, Lin Y, Zhang W: Nonlinear stochastic passivity, feedback equivalence and global stabilization. Int. J. Robust Nonlinear Control 2012, 22: 999-1018. 10.1002/rnc.1742
Spiliotis J, Tsinias J: Notions of exponential robust stochastic stability, ISS and their Lyapunov characterizations. Int. J. Robust Nonlinear Control 2003, 13: 173-187. 10.1002/rnc.724
Trinh H, Fernando T: Functional Observers for Dynamical Systems. Springer, Berlin; 2012.
Xie XJ, Tian J: State-feedback stabilization for high-order stochastic nonlinear systems with stochastic inverse dynamics. Int. J. Robust Nonlinear Control 2007, 17(14):1343-1362. 10.1002/rnc.1177
Lan TTT, Dang HN: Exponential stability of nontrivial solutions of stochastic differential equations. Scientia, Ser. A, Math. Sci. 2011, 21: 97-106.
The authors thank the referees for valuable comments and suggestions which improved the presentation of this manuscript.
The authors declare that they have no competing interests.
All authors read and approved the final manuscript.
About this article
Cite this article
Abedi, F., Leong, W.J. & Chaharborj, S.S. A notion of stability in probability of stochastic nonlinear systems. Adv Differ Equ 2013, 363 (2013). https://doi.org/10.1186/1687-1847-2013-363