- Research
- Open access
- Published:
Stability and Hopf bifurcation analysis of fractional-order complex-valued neural networks with time delays
Advances in Difference Equations volume 2017, Article number: 225 (2017)
Abstract
This paper considers a class of fractional-order complex-valued Hopfield neural networks (CVHNNs) with time delay for analyzing the dynamic behaviors such as local asymptotic stability and Hopf bifurcation. In the case of a neural network with hub and ring structure, the stability of the equilibrium state is investigated by analyzing the eigenvalue of the corresponding characteristic matrix for the hub and ring structured fractional-order time delay models using a Laplace transformation for the Caputo-fractional derivatives. Some sufficient conditions are established to guarantee the uniqueness of the equilibrium point. In addition, conditions for the occurrence of a Hopf bifurcation are also presented. Finally, numerical examples are given to demonstrate the effectiveness of the derived results.
1 Introduction
The discipline of neural networks, as other fields of science, has a long history of evolution with lots of ups and downs. In 1943 Warren McCulloch and Walter Pitts presented the first model of artificial neurons, named the Threshold Logic Unit (TLU). In the last few decades, the subjective analysis of neural networks (NNs) has received huge attention because of its strong applications in numerous fields such as signal and image processing, associative memories, combinatorial optimization and many others [1–6]. However, such practical applications of NNs are strongly dependent on the qualitative behaviors of NNs. In both biological and physical models, the occurrence of time delays plays an important role. Time delay, which happens usually due to system process and information flow to a particular part of dynamical systems, is unavoidable. Time delays in NNs may cause unexpected dynamical behaviors, like oscillation and poor performance, in networks; see [7–11]. Thus, the analysis on NNs with the effects of time delays has attracted the attention of many researchers and results have been published [12–17]. The stability of neural networks with both leakage delay and a reaction-diffusion term is discussed, and several sufficient conditions were obtained with the help of analysis technique and Lyapunov theory [16]. The problem of fixed-time synchronization of memristive neural networks was studied in [17].
Fractional calculus was introduced many years ago [8, 9, 18, 19], but in recent years the development of fractional calculus was improved step by step in many fields such as engineering mathematics, applied mathematics, and many fields of physics. Thus, recently researchers were strongly attracted towards fractional-order systems compared with the integer-order one because of their great advantage of infinite memory and hereditary properties [3, 19–22]. In the field of neural networks, since the importance of the memory term is extremely high, the incorporation of fractional terms into neural networks leads to a new class of networks called fractional-order NNs [23]. Fractional-order neural networks with parameters such as state vectors, nonlinear activation functions and weight functions in a complex domain \(\mathbb{C}^{n}\) are called fractional-order complex-valued neural networks (CVNNs) [3, 7, 24–28]. CVNNs has more remarkable applications in various dynamical systems, such as Lyapunov asymptotic stability, global stability and Hopf bifurcations compared with the real-valued NNs [8, 18, 29–32]. In real-valued NNs, continuously differentiable and bounded sigmoid activation functions are to be chosen, but in the case of a complex domain the activation functions are entire bounded, and they will reduce to a constant in the complex domain according to the Liouville theorem [18]. Therefore in the complex domain choosing the appropriate activation function is a great challenge [7, 33].
NNs contain several types of structures such as hub structure, ring structure and so on. In NNs, for appropriate neuronal wiring, it is necessary to have coordinated activation of neuronal assemblies. Hypothetically a few highly linked neurons with long ranging connectivity, the ‘hub neurons’, would be the most effective manner to organize network-wide synchronicity. Therefore, it is significant to consider the hub structure in neural networks to realize better performance. Moreover, ring architectures can be found in a number of neural structures from neurons in the mind and other sciences. The factual cortical bonding prototype is tremendously sparse. Almost all connections among adjacent cells and long range links became very rare. Thus, ring NNs can be analyzed to gain better understanding of the mechanisms underlying the performance of NNs. Many authors have discussed global stability, Lyapunov stability for the fractional-order NNs, see [2, 14, 27, 29, 33–37], and for finite-time stability results are discussed in [26] and bifurcation of a delayed fractional systems is considered in [5, 38–40].
Stability theory is one of the most important and rapidly developing fields of applied mathematics and mechanics. In the design of a dynamical neural network it is always of interest to study the stability properties of the network. The stability studies in NNs have been developed finding the conditions which ensure that each trajectory of the network converges to an equilibrium point depending on the initial conditions. These completely stable NNs have been used as computing and cognitive machines. Moreover, it is well known that the dynamic behaviors such as periodic phenomenon, bifurcation and chaos are also of great interest. In general, in a dynamical system, if a parameter is allowed to vary, then the behavior of the whole dynamical system may change. The value of the parameter at which these changes occur is known as the bifurcation value and the parameter that is varied is known as the bifurcation parameter. In delay differential equations, Hopf bifurcation occurs in systems of differential equations consisting of two or more equations. Even though there is an extensive literature on bifurcation analysis of some special NNs, most of them deal only with the two-equation models and there were only few papers on the bifurcations of the high-dimensional models [41–46]. However, all above mentioned works are on the bifurcation analysis of integer-order NNs. Nevertheless, most results on the integer-order NNs cannot be simply extended to the case of the fractional-order one. To the best of our knowledge, no work on the Hopf bifurcation analysis of fractional-order CVHNNs with hub structure and ring structure has been proposed in the literature. Therefore, this paper aims at fulfilling such a gap by investigating the stability and Hopf bifurcation of a class of delayed fractional-order CVHNNs with hub structure and ring structure.
Motivated by the above discussion, in this paper we investigate the stability and Hopf bifurcation of the fractional-order CVHNNs with time delays in two types of structures named ring and hub structures. First we consider the fractional-order CVHNNs in the hub structure with time delays. Later the sufficient conditions for stability of the fractional system with respect to the equilibrium point of the system are derived by using some inequality techniques. Further, the bifurcation point of the hub structure with the corresponding critical frequency of the system and for the case similar to the ring structured one are derived. By using the bifurcation point and critical frequency the transversality condition is verified for the point of bifurcation occurring.
The rest of the paper is organized as follows. Necessary basic definitions and a problem description are given in Section 2. In Section 3, the two structures of fractional-order CVHNNs with time delays to investigate the stability and Hopf bifurcation point of the system are presented and two numerical examples are to validate the efficacy of our theoretical findings in Section 4 and lastly a conclusion is discussed in Section 5.
Notations and preliminaries. The authors have derived the results using the following notations in this paper. \(\mathbb{R}^{n}\) and \(\mathbb{C}^{n}\) are n-dimensional euclidean space and n-dimensional complex domain, respectively. \(z(t)\) is a complex variable and is denoted \(z(t) = x(t) + i y(t)\), which is in the complex domain. \({}_{0}^{C} D_{t}^{\alpha}z(t)\) denotes the Caputo-fractional derivative of the complex variable \(z(t)\). There are several definitions of fractional-order derivatives and fractional integrals are extensively used, named the Riemann-Liouville derivative and integrals, the Caputo derivative, and Grunwald-Letnikov derivative etc. In this section we give the definitions of the first two.
Definition 1
[6]
The Riemann-Liouville fractional derivatives \(D_{a+}^{ \alpha}g\) and \(D_{b-}^{\alpha}g \) of order \(\alpha\in C ([R(\alpha)]\geq0)\) are defined by
and
where \([R(\alpha)]\) means that integral part of \(R(\alpha)\).
Definition 2
[13]
The Riemann-Liouville fractional integral of order \(\alpha>0 \) for a continuous function \(g:\mathbb{R}^{+}\rightarrow \mathbb{R}\) is defined as
where \(I^{\alpha}\) denotes the Riemann-Liouville fractional integral of order α and \(\Gamma(\alpha) \) is the Gamma function.
Definition 3
[47]
The Caputo-fractional derivative of order \(\alpha>0\) for a function \(g\in\mathbb{C}^{n+1}([0,\infty),\mathbb{R})\) is as follows (the set of all \(n+1 \) order continuous differentiable functions on \([0,\infty) \) is used):
where n is the first integer greater than α, that is, \(n-1<\alpha<n\).
Especially, when \(\alpha\in(0,1) \)
Definition 4
[13]
The Gamma function is defined as
where the \(\operatorname {Re}(z)\) is the real part of z.
2 Model description
In this section we announce the stability analysis of the following fractional-order CVHNNs system with time delays:
Here, \(\alpha\in(0,1)\), \(z_{r}\) are the complex state variables, \((z(t) = (z_{1}(t),z_{2}(t),z_{3}(t),\ldots,z_{n}(t))^{T})\), \(c_{r} \in\mathbb{R}^{n \times n}\) are the self-regulating parameters of the neurons, \(A=(a_{rm})_{n \times n}\), \(B=(b_{rm})_{n\times n}\) are the complex inter connection matrices without and with time delays t and \(t-\gamma_{rm}\). The \(f_{m} : \mathbb{C} \rightarrow \mathbb{C} \) are the complex-valued activation functions for the input-output neurons and the system (1) can be written as
where \(Z(t)=(z_{1}(t),z_{2}(t),z_{3}(t),\ldots,z_{n}(t))^{T}\), \(C=\operatorname {diag}(c_{1},c_{2},c_{3},\ldots,c_{n}) \in\mathbb{R}^{n \times n}\) (for each \(c_{r}>0\)), \(A=(a_{rm})_{n \times n} \in\mathbb{C}^{n \times n}\), \(B=(b_{rm})_{n \times n}\in\mathbb{C}^{n \times n} \).
The activation functions are given by \(F(z(t))=(f_{1}(z_{1}(t)),f_{2}(z _{2}(t)),f_{3}(z_{3}(t)),\ldots, f_{n}(z_{n}(t)))^{T}\), \(F(z(t-\gamma)) = ( f_{1}(z_{1}(t-\gamma_{r1})),f_{2}(z_{2}(t-\gamma _{r2})),\ldots,f_{n}(z_{n}(t-\gamma_{rn})))^{T}\), \(r=1,2,3,\ldots,n\). We denote \(z(t)=x(t)+i y(t)\), \(z(t_{\gamma})=z(t-\gamma) = x(t- \gamma) + i y(t-\gamma)\), \(A = A^{R}+i A^{I}\), \(B=B^{R}+i B^{I} \) and \(f(z)=f^{R}(x,y)+if^{I}(x,y)\) with \(x,y:\mathbb{R} \rightarrow \mathbb{R}^{n}\), \(A^{R},A^{I},B^{R},B^{I} \in\mathbb{R}^{n \times n}\); the system (2) can be equivalently written as the following real-valued fractional-order system:
Now, consider \(u(t) = (x(t),y(t))^{T} \in\mathbb{R}^{2n}\),
The system (3) and (4) can be written as
Let us consider \(u^{*} = (x^{*},y^{*})^{T}\) to be an equilibrium state of the system (1). In general, for the linearization of system (5) at the equilibrium point the system can be written as
Here \(C=\operatorname {diag}(c_{1},c_{2},c_{3},\ldots,c_{n})\), \(\bar{A}^{R}=( \bar{a}^{R}_{pq})_{n \times n}\), \(\bar{A}^{I}=(\bar{a}^{I}_{pq})_{n \times n}\), \(\bar{B}^{R}=(\bar{B}^{R}_{pq})_{n \times n}\) and \(\bar{B}^{I}=(\bar{b}^{I}_{pq})_{n \times n}\). Now taking the Laplace transform on both sides of the system (6), we get the Jacobian matrix of the system as
where
and
The characteristic matrix of the system (6) is \(J(s)\) and the characteristic polynomial is obtained by taking the determinant of \(J(s) \). The stability of the equilibrium state \(Z^{*}=(z^{*}_{1},z ^{*}_{2},\ldots,z^{*}_{n})\) in the fractional-order system is determined by the eigenvalues of \(\operatorname {Det}(J(s))\).
Lemma 1
[3]
If all the roots of the characteristic equation \(\operatorname {Det}(J(s))\) have negative real parts, then the zero equilibrium of system (1) is Lyapunov globally asymptotically stable.
Lemma 2
[3]
If the order of the system (1) lies between 0 and 1 all the characteristic roots of the matrix \(J(s)\) satisfy \(\vert \arg( \lambda) \vert >\frac{\alpha\pi}{2}\) and the characteristic equation \(\operatorname {Det}(J(s))\) has no purely imaginary roots for any \(\gamma_{rm}>0\), \(r=m=1,2,3,\ldots,n\), then the zero equilibrium solution of system (1) is Lyapunov globally asymptotically stable.
To determine our theoretical results we make the following hypothesis:
- \((\mathbb{H}1)\) :
-
The nonlinear activation functions \(f_{q}\) (\(q=1,2,3,\ldots,n\)) satisfies the Lipschitz condition, that is, there exist constants \(F_{k} > 0 \) such that
$$ \bigl\vert f_{q}(x)-f_{q}(y) \bigr\vert \leq F_{k} \vert x-y \vert , \quad\mbox{for all } x,y\in \mathbb{R}. $$ - \((\mathbb{H}2)\) :
-
There exist constants \(\zeta_{p}\) (\(p=1,2,3,\ldots,n\)) such that the following inequality holds:
$$ \zeta_{p} c_{p} > \sum_{k=1}^{n} \zeta _{p} \bigl(F_{k} \vert a_{pk} \vert +F_{k} \vert b_{pk} \vert \bigr),\quad p=1,2,3,\ldots, n. $$
Lemma 3
[38]
If hypotheses \((\mathbb{H}1)\) and \((\mathbb{H}2)\) are satisfied then there exists a unique equilibrium point for the system (1).
Remark 1
From Lemma 3, we can conveniently discuss the existence and uniqueness of the equilibrium point for neural networks.
3 Main results
3.1 Fractional-order CVHNNs with hub structure and time delays
In this section, we consider the fractional-order CVHNNs for \(n\geq3\) neurons with hub structure and time delays to investigate the stability and Hopf bifurcation phenomenon,
where \(\alpha\in\mathbb{R}\) and \(0< \alpha<1\), \(c_{1},c_{r}>0\) (\(r=2,3,\ldots,n\)). \(z_{r}(t)\) are complex states. Here, the first neuron (named the central neuron) is the center of the hub, and all the other \(r-1\) neurons (named the peripheral neurons) are connected directly only to the central neuron and to themselves. The interconnection matrix of this neural network model (7) is,
Let \(Z^{*}=(z_{1}^{*},z_{2}^{*},\ldots,z_{n}^{*})^{T} \) be an equilibrium point of the system (7). The system (7) can be written in the following vector form:
with diagonal matrix \(C=(c_{1},c_{2},c_{3},\ldots,c_{n}) \in \mathbb{R}^{n \times n}\), \(A, B \in\mathbb{C}^{n \times n}\), \(F(z(t))=(f _{1}(z_{1}(t)),f_{2}(z_{2}(t)), f_{3}(z_{3}(t)),\ldots,f_{n}(z_{n}(t)))^{T}\), \(F(z(t_{\gamma}))=(f _{1}(z_{1}(t-\gamma_{1})),f_{2}(z_{2}(t-\gamma)),f_{3}(z_{3}(t- \gamma)),\ldots, f_{n}(z_{n}(t-\gamma)))^{T}\) for the linearization of system (8) about the equilibrium point of the system (7) and we assume \(\gamma_{1}=\gamma\). The system (8) is linearized and the vector form of the system is
where \(C= \lceil c_{1},c_{2},c_{3},\ldots,c_{n} \rfloor\),
Taking the Laplace transform on both sides of (9), we have
where \(z_{r}(s) \) is the Laplace transform of \(z_{r}(t) \), that is, \(z_{r}(s) = L(z_{r}(t)) \), \(r=1,2,3,\ldots,n\), \(\psi_{r}(t)\), \(r=1,2,3,\ldots,n \), \(t\in[-\gamma,0 )\), is the initial value of (7). Moreover, the above equation can be rewritten as follows:
where \(Z(s)=(z_{1}(s),z_{2}(s),z_{3}(s),\ldots,z_{n}(s))^{T}\), \(G(s)=(g_{1}(s),g_{2}(s),g_{3}(s),\ldots,g_{n}(s))^{T}\), \(g_{1}(s)= s^{\alpha-1} \psi_{1}(0)+ \bar{b}_{1} e^{-s \gamma} \int _{-\gamma}^{0} e^{-st} \psi_{1}(t) \,dt, g_{2}(s)=s^{\alpha-1} \psi_{2}(0)+\bar{b} e^{-s \gamma} \int _{-\gamma}^{0} e^{-st} \psi_{2}(t) \,dt, g_{3}(s)=s^{\alpha-1} \psi_{3}(0)+\bar{b} e^{-s \gamma} \int _{-\gamma}^{0} e^{-st} \psi_{3}(t) \,dt,\ldots, g_{n}(s)=s^{\alpha-1} \psi_{n}(0)+\bar{b} e^{-s \gamma} \int _{-\gamma}^{0} e^{-st} \psi_{n}(t) \,dt\).
For convenience, we take
Then the Jacobian matrix of the system (9) is
It follows that \(J(Z^{*}) \) is an \(n\times n \) matrix (\(n\geq3\) in hub structure). Now we find the determinant of \(J(Z^{*})\), that is, \(\operatorname {Det}(J(Z^{*}))=0\). The characteristic equation \(\operatorname {Det}(J(z^{*}))=0\) determines the local stability of the equilibrium solution. The characteristic roots of \(J(Z^{*}) \) satisfy the characteristic equation \(\operatorname {Det}(J(z^{*}))=0\).
If \(n=3\), the characteristic equation \(\operatorname {Det}(J(Z^{*}))=0\) satisfies
If \(n=4\), the characteristic equation \(\operatorname {Det}(J(Z^{*}))=0\) satisfies
If \(n=5\), the characteristic equation \(\operatorname {Det}(J(Z^{*}))=0\) satisfies
where \(P=c_{1}-\bar{a}_{11}-\bar{b}_{1} e^{-s \gamma}\), \(Q=c_{r}- \bar{a}_{rr}-\bar{b} e^{-s \gamma}\), \(H=\sum_{m=2}^{n} a_{1m}a _{m1}\), \(r=2,3,\ldots,n\).
The characteristic equation \(\operatorname {Det}(J(Z^{*}))=0\) satisfies
with \(P,Q,H \in\mathbb{C} \) defined above depending on the equilibrium \(\mathbb{Z}^{*}\) and the system parameters \(c_{1}\), \(c_{r}\), \(a_{rm}\), \(b_{1}\), b. Then the characteristic equation (13) will have the form
If the peripheral neurons are identical, then for convenience we take \(Q =c_{2}-\bar{a}_{22}-\bar{b} e^{-s \gamma} \). Then (14) can be written as
\(s^{2 \alpha} + (c_{1}-\bar{a}_{11}-\bar{b}_{1} e^{-s \gamma}+c _{2}-\bar{a}_{22}-\bar{b} e^{-s \gamma}) s^{\alpha}+ (c_{1}-\bar{a} _{11}-\bar{b}_{1} e^{-s \gamma})(c_{2}-\bar{a}_{22}-\bar{b} e^{-s \gamma}) -H=0\), then it can be written in the form of
where \(C_{l}\) (\(l=1,2,\ldots,5\)) are defined by \(C_{1}=((c_{1}+c_{2})-( \bar{a}_{11}+\bar{a}_{22}))\), \(C_{2}=(c_{1} c_{2}-c_{1} \bar{a}_{22}-\bar{a}_{11} c_{2} + \bar{a} _{11}\bar{a}_{22}-H)\), \(C_{3}=\bar{a}_{11} \bar{b}+\bar{a}_{22}\bar{b} _{1}-\bar{b}_{1} c_{2}-\bar{b} c_{1}\), \(C_{4}=-(\bar{b}_{1}+\bar{b})\), \(C_{5}=\bar{b}_{1}\bar{b}\). For investigating (15), we obtain the following characteristic polynomial:
where \(E_{1}(s)=s^{2 \alpha}+C_{1} s^{\alpha}+C_{2}\), \(E_{2}(s)=C_{3}+C _{4}s^{\alpha}\), \(E_{3}(s)=C_{5}\).
By multiplying \(e^{s \gamma} \) on both sides of (16), we get
Let \(A_{r}\) and \(B_{r} \) be the real and imaginary parts of \(E_{r}(s)\) (\(r=1,2,3\)) and \(A_{r}\), \(B_{r}\) (\(r=1,2,3\)) are defined as
and
Then by using \(A_{r}\), \(B_{r}\) and substituting (18) in (17) we get
Further, we will analyze stability and bifurcation properties; for this we consider the real number \(\omega> 0\), there exists \(s=\omega i= \omega(\cos \frac{\pi}{2}+i \sin\frac{\pi}{2})\), then we substitute the expression of s into (19), which gives
then separating the real and imaginary parts of (20) and squaring both sides we get
According to \(\sin \omega\gamma=\pm\sqrt{1-\cos ^{2} \omega\gamma}\), this leads to following two cases.
Case (a): If \(\sin \omega\gamma= \sqrt{1-\cos ^{2} \omega\gamma}\), then it takes the following form:
It can be concluded that
where
As we know quadratic equation (22) has roots. We can obtain the expression of \(\cos\omega\gamma\) can be deduced from (22) and is denoted as \(f_{1}(\omega)\), that is, \(\cos\omega\gamma=f _{1}(\omega)\), Then substituting \(\cos\omega\gamma=f_{1}(\omega ) \) into equation (21) we get the expression of \(\sin\omega \gamma\) and it is represented as \(f_{2}(\omega)\). Both \(f_{1}( \omega) \) and \(f_{2}(\omega)\) are functions with respect to ω and
Moreover, \(f_{1}^{2}(\omega)+f_{2}^{2}(\omega)=1\). We obtain
Case (b): If \(\sin\omega\gamma= - \sqrt{1- \cos^{2} \omega \gamma}\), similar to Case (a), we can obtain \(\cos\omega\gamma= g _{1}(\omega)\) and \(\sin\omega\gamma=g_{2}(\omega)\), where \(g_{1}(\omega) \), \(g_{2}(\omega)\) is a function with respect to ω. Here ω is the root of the equation \(g_{1}^{2}( \omega)+g_{2}^{2}(\omega)=1\). If we take \(g_{1}(\omega)=\cos \omega\gamma\), we have
We will take that \(f_{1}^{2}(\omega)+f_{2}^{2}(\omega)=1\) or \(g_{1}^{2}(\omega)+g_{2}^{2}(\omega)=1\), having at least one positive real root, thus the bifurcation point is defined as
where \(\gamma_{1}^{(k)}\), \(\gamma_{2}^{(k)}\) are defined in (23) and (24).
Now, we examine the stability of system (7) for \(\gamma=0\), the characteristic equation (15) becomes
Equation (26) can be converted to
where
It is defined as
from the above we make the following hypotheses:
- \((\mathbb{H}3)\) :
-
\(\Psi_{i} > 0\) (\(i=1,2\)).
Lemma 4
If \(\Psi_{1} > 0\) and \(\Psi_{2} > 0 \) holds, then the zero equilibrium point of the fractional-order system (7) is asymptotically stable when \(\gamma=0 \).
Remark 2
The conditions \(\Psi_{1} > 0\) and \(\Psi_{2} > 0 \) are sufficient condition for Lemma 4. If the conditions are retrieved by another method which entails that all the roots of equation (13) satisfy \(\vert \arg (\lambda) \vert > \frac{\alpha\pi}{2}\) then Lemma 4 may still hold.
In order to achieve the transversality condition for the occurrence for Hopf bifurcation, the following further hypothesis is needed:
- \((\mathbb{H}4)\) :
-
\(\operatorname {Re}[ \frac{ds}{d \gamma} ] | _{( \gamma= \gamma_{0} , \omega= \omega_{0})} \neq0\), where \(\gamma_{0}\) and \(\omega_{0}\) are bifurcation point and critical frequency, respectively.
By using the implicit function theorem and taking the derivative of s with respect to γ in (16), then
Here
It can be deduced from (28) that
then we take
where \(X_{1}\), \(X_{2}\) are the real and imaginary parts of \(X(s)\) and \(Y_{1}\), \(Y_{2}\) are the real and imaginary parts of \(Y(s)\), which are defined as
From the above investigation we can state the following theorem.
Theorem 1
Assume that \((\mathbb{H}1)\)-\((\mathbb{H}4)\) are satisfied for system (7), the following results hold:
-
(1)
The zero equilibrium point is asymptotically stable for \(\gamma\in[0, \gamma_{0} ) \).
-
(2)
The system (7) exhibits a Hopf bifurcation at the origin when \(\gamma=\gamma_{0} \), that is, the system (7) has a branch of periodic solutions bifurcating from the zero equilibrium point near \(\gamma=\gamma_{0} \).
Remark 3
The results on stability and Hopf bifurcation of fractional-order CVHNNs with hub structure and time delays have not been attained before. The determined conditions on bifurcation are very straightforward, detailed and impressive and simple to be verified in the present work by applying Hopf bifurcation theory. Our work is to develop the study of the theory of nonlinear dynamics.
3.2 Fractional-order CVHNNs with ring structure and time delays
In this section we consider the fractional-order CVHNNs with ring structured network and time delay as
where the order \(\alpha\in(0, 1)\), \(z_{p}(t) \) (\(p=1,2\)) are complex states, \(c_{r}> 0\) (\(r = 1 , 2\)) are real values, γ is the time delay, f is the nonlinear activation function. A neural network with the ring connectivity structure is in (30), in which every neuron in the network is connected only to its closest neurons. It is clear that the \(Z^{*}\) is an equilibrium point of (30). We generate the following hypothesis on the nonlinear activation functions to the system in (30):
- \((\mathbb{A}1)\) :
-
\(f_{p} \in\mathbb{C}^{1}(\mathbb {R}, \mathbb{R})\), \(f_{p}(0)=0\),
we may consider steady state \(Z^{*} \) with equal complex scalar components \(Z_{1}^{*}=Z_{2}^{*}=Z^{*}\).
Obviously, from \((\mathbb{A}1)\) \(Z^{*}=0\) is a solution of this equation as the trivial solution is a steady state of (30), then
Linearization of the above system with respect to the equilibrium state of the system (30) leads to
Then it can be written in the following form:
where \(\bar{a}_{rm}=a_{rm}f'(0)\) and \(\bar{b}_{rm}=b_{rm}f'(0)\), \(r,m=1,2\).
The system parameters \(a_{rm}\), \(b_{rm}\) (\(r,m =1,2\)) are connection weights of the neural network and we have the complex domain. We take the Laplace transform on both sides of (32) and (33),
where \(Z_{1}(s)\), \(Z_{2}(s)\) are the Laplace transforms of \(z_{1}(t)\), \(z _{2}(t)\), that is, \(L[z_{p}(t)]=Z_{p}(s)\), \(p=1,2\), and \(\psi_{1}(t)\), \(\psi_{2}(t)\), are the initial values of the (30). Then it can be written as
where
We will study the behavior of dynamical system by using two feasible equilibria. The characteristic equation for system (34) is
By (35), we can obtain the characteristic equation
where \(E_{1}(s)=s^{2\alpha}+C_{1}s^{\alpha}+C_{2}\), \(E_{2}(s)=C_{3}s ^{\alpha}+C_{4}\), \(E_{3}(s)=C_{5}\).
The coefficients are defined by \(C_{1}=-\bar{a}_{11}-\bar{a}_{22}+c _{1}+c_{2}\), \(C_{2}=-\bar{a}_{12}\bar{a}_{21}+\bar{a}_{11}\bar{a}_{22}- \bar{22}c_{1}-\bar{a}_{11}c_{2}+c_{1}c_{2}\), \(C_{3}=-\bar{b}_{11}- \bar{b}_{22}\), \(C_{4}=\bar{a}_{11}\bar{b}_{22}-\bar{b}_{22}c_{1}- \bar{b}_{11}c_{2}+\bar{a}_{22}\bar{11}-\bar{a}_{21}\bar{b}_{12}- \bar{a}_{12}\bar{b}_{21}\), \(C_{5}=-\bar{b}_{12}\bar{b}_{21}+\bar{b}_{11} \bar{b}_{22}\) and
The characteristic equation (36) determines the local stability of the equilibrium solution; the system (30) is stable iff all the eigenvalues of (35), having the solutions of
have negative real parts. It is well known that the equilibrium state \(Z^{*}\) is stable if all roots of (36) have negative real parts, and unstable if one root has a positive real part. Multiplying \(e^{s\gamma}\) on both sides of (38), it is obvious that
If \(s=i\omega=\omega ( \cos \frac{\pi}{2}+i \sin \frac{ \pi}{2} ) \), \(\omega>0\) is a root of (39) iff ω satisfies the following equations, we obtain
\(A_{r}\), \(B_{r}\) (\(r=1,2,3\)) are the real and imaginary parts of \(E_{r}(s)\) (\(r=1,2,3\)), respectively. Then (40) can be written as follows:
Separating the real and imaginary parts of the above leads to
where
Accordingly \(\sin^{2}\omega\gamma+\cos^{2} \omega\gamma=1\) leads to the following two cases.
Case (a): If we take \(\sin\omega\gamma= \sqrt{1-\cos ^{2} \omega\gamma}\), then we have
It can be concluded from that
where
From this we can obtain the interpretation of the \(\cos\omega \gamma\) and denote \(\cos \omega\gamma=d_{1}(\omega)\). Using the expression of \(\cos \omega\gamma\) in (41) then we get \(\sin\omega\gamma\) and it is denoted \(\sin\omega\gamma=d _{2}(\omega)\), where \(d_{1}(\omega)\) and \(d_{2}(\omega)\) is functions with respect to ω.
We know that \(\sin^{2}\omega\gamma+\cos^{2} \omega\gamma=1\), from this identity we obtain \(d_{1}^{2}(\omega)+d_{2}^{2}(\omega)=1 \).
Hence, we get
Case (b): Now consider \(\sin\omega\gamma= - \sqrt{1- \cos ^{2} \omega\gamma}\), in the same way as Case (a), we can obtain \(\cos\omega\gamma= h_{1}(\omega)\), where \(h_{1}(\omega) \), \(h_{2}(\omega)\) is a function with respect to ω. It is the roots of the polynomial equation \(h_{1}^{2}(\omega)+h_{2}^{2}(\omega )=1\), where \(h_{2}(\omega)= \sin \omega\gamma\). In a similar way to Case (a) we find the value of ω in view of \(h_{1}( \omega)=\cos \omega\gamma\), we have
Here \(d_{1}^{2}(\omega)+d_{2}^{2}(\omega)=1 \), which has at least one positive real root, thus the bifurcation point is defined as
where \(\gamma_{1}^{(j)}\), \(\gamma_{2}^{(j)}\) are defined by (43) and (44).
Now, we analyze the stability of system (30) when \(\gamma=0\), so the characteristic equation (40) becomes
Then (46) can be written as
where
It is defined as
- \((\mathbb{A}2)\) :
-
\(\chi_{i} > 0\) (\(i=1,2\)).
Lemma 5
If \(\chi_{1} > 0\) and \(\chi_{2} > 0 \), then the equilibrium point of the fractional-order CVHNNs with ring structured and time delay system (30) is stable when \(\gamma=0 \).
Now, considering the transversality condition of the occurrence for a Hopf bifurcation, it is given by
- \((\mathbb{A}3)\) :
-
\(\operatorname {Re}[ \frac{ds}{d \gamma} ] | _{( \gamma= \gamma_{0} , \omega= \omega_{0})} \neq0\),
where \(\omega_{0}\) and \(\gamma_{0}\) are the critical frequency and the bifurcation point. Taking the derivative of s with respect to γ in (39), we have
coming by the same procedure as in the hub structure of earlier section, we have the condition for the Hopf bifurcation
where \(N_{1}\), \(N_{2}\) are the real and imaginary parts of \(X(s)\) and \(M_{1}\), \(M_{2}\) are the real and imaginary parts of \(Y(s)\). The terms in \(M_{1}\), \(M_{2}\), \(N_{1}\) and \(N_{2}\) have the same meaning as where we mentioned \(Y_{1}\), \(Y_{2}\), \(X_{1}\) and \(X_{2}\) in Section 3.1. The above analysis leads to the following theorem.
Theorem 2
Assume that \((\mathbb{H}1)\)-\((\mathbb{H}2)\) and \((\mathbb{A}1)\)-\(( \mathbb{A}3)\) are satisfied for fractional-order system (30), the following results hold:
-
(1)
The zero equilibrium point is locally asymptotically stable for \(\gamma\in[0, \gamma_{0} ) \).
-
(2)
The fractional-order system (30) exhibits a Hopf bifurcation at the origin when \(\gamma=\gamma_{0} \), that is, the system (30) has a branch of periodic solutions bifurcating from the zero equilibrium point near \(\gamma=\gamma_{0} \).
4 Numerical examples
In this section, numerical examples are given to verify the effectiveness of the analytical results. The simulation results are based on the Adams-Bashforth-Moulton predictor-corrector scheme for considered examples. The step length is taken in all the examples as \(h=0.01\).
Example 1
In this example, the occurrence of Hopf bifurcation problem is investigated for the fractional-order CVHNNs with the hub structure and time delay system (7). Consider the following fractional-order CVHNNs (for arbitrary order \(\alpha=0.9\)) of four neurons with hub structure and time delay:
Here the activation function is \(f(z)=\tanh(z)\), it is obvious that system (50) admits a zero equilibrium point with the complex derivative \(f'(0)=1\). The considered fractional-order CVHNNs (50) is compared to (7), we have \(c_{1}=3\), \(c_{2}=c _{3}=c_{4}=2.8\), \(b_{1}=2-i\), \(b=-2-2i\), \(a_{11}=-1+1.5i\), \(a_{22}=a_{33}=a _{44}=2+0.2i\), \(a_{12}=-2.4+3.2i\), \(a_{13}=3-0.3i\), and \(a_{14}=1.6-1.5i\), the initial values of the activation function are chosen as \(z_{1}(0)=0.1+0.6i\), \(z_{2}(0)=0.2+0.4i\), \(z_{3}(0)=0.3+0.5i\), \(z_{4}(0)=0.1+0.3i\). We derive the critical frequency \(\omega_{0} =0.42 \) and the bifurcation point \(\gamma_{0} =0.32 \). Figure 1 shows the occurrence of a bifurcation point at \(\gamma_{0}= 0.32\) and the system is unstable when \(\gamma= 0.45 >\gamma_{0}= 0.32\). According to Theorem 1, the zero equilibrium point (0,0,0,0) is asymptotically stable when \(\gamma=0.31 < \gamma_{0}=0.32 \), which is depicted in Figure 2. In Figure 3, we show that the curve for the imaginary parts of \(z_{3}(t)\) and \(z_{4}(t)\) are unstable for \(\gamma= 0.45 >\gamma _{0}= 0.32\) and real parts of \(z_{1}\), \(z_{2}\), \(z_{3}\), \(z_{4}\) are stable for \(\gamma= 0.31 < \gamma_{0} = 0.32\). In Figure 4, we show the curve for the real parts is unstable for the system (50) for \(\gamma= 0.45 >\gamma_{0}= 0.32\) and a stability phase portrait is depicted in Figure 4 and Figure 5, for \(\gamma= 0.31 < \gamma_{0} = 0.32\). Figure 6 illustrates the phase portrait of the instability for (50), when \(\gamma= 0.45 >\gamma_{0}= 0.32\).
Example 2
Consider the following fractional-order CVHNNs of two neurons with ring structure and time delay:
The values for (51) are chosen as \(c_{1}=0.2\), \(c_{2}=-0.3\), \(a _{11}=-0.3-0.4i\), \(a_{22}=-0.5-0.4i\), \(a_{12}=-0.6+0.2i\), \(a_{21}=0.5-0.3i\), and \(b_{11}=-1-1i\), \(b_{22}=-0.3+1i\), \(b_{12}=0.1+0.3i\), \(b _{21}=0.5-0.3i\). The activation functions are defined as \(f_{1}(z_{1}(t))= \tanh(z_{1})\), \(f_{2}(z_{2}(t))=\tanh(z_{2})\) and the initial values are chosen as \(z_{1}(0)=0.4+0.3i\), \(z_{2}(0)=0.2+0.5i\). The critical frequency \(\omega_{0} =1.25 \) and the bifurcation point \(\gamma_{0} =0.3 \) is obtained in Maple by simple calculations. The occurrence of the bifurcation point \(\gamma_{0}= 0.3\) is shown in Figure 7 and also the system (51) is unstable for \(\gamma= 0.45>\gamma_{0}=0.3\). According to Theorem 2, the zero equilibrium point is locally asymptotically stable when \(\gamma= 0.2 < \gamma_{0} =0.3 \), which is illustrated in Figure 8 and Figure 9. The phase portraits of stable and unstable versions of system (51) are represented in Figure 10.
5 Conclusions
In this paper, the class of fractional-order CVHNNs with hub and ring structured system is considered in a time delay sense. In this paper we use the Laplace transforms to the system of linearized equation to get the characteristic matrix for further stability analysis of the equilibrium which has been completely characterized. The critical frequency of the fractional-order α for which the corresponding bifurcation point may occur has been identified and the transversality condition is verified for the corresponding \(\omega_{0}\) and \(\gamma_{0}\). Moreover, the obtained conditions are simple, precise, effective and easy to verify. Numerical examples are given to verify the effectiveness of the theoretical results. Future work will focus on the analysis of stability and Hopf bifurcation of high-dimensional fractional-order ring structure CVHNNs with multiple delays.
References
Cochocki, A, Unbehauen, R: Neural Networks for Optimization and Signal Processing. Wiley, New York (1993)
Gopalsamy, K, He, X: Stability in asymmetric Hopfield nets with transmission delays. Phys. D: Nonlinear Phenom. 76, 344-358 (1994)
Huang, C, Cao, J, Xiao, M, Alsaedi, A, Hayat, T: Bifurcations in a delayed fractional complex-valued neural network. Appl. Math. Comput. 292, 210-227 (2017)
Hirose, A: Complex-Valued Neural Networks. Springer, Berlin (2006)
Kim, T, Adali, T: Fully complex multi layer perceptron network for nonlinear signal processing. J. VLSI Signal Process. Syst. Signal Image Video Technol. 32, 29-43 (2002)
Lin, S, Lu, C: Laplace transform for solving some families of fractional differential equations and its applications. Adv. Differ. Equ. 2013, 137 (2013)
Li, X, Rakkiyappan, R, Velmurugan, G: Dissipativity analysis of memristor-based complex-valued neural networks with time-varying delays. Inf. Sci. 294, 645-665 (2015)
Rakkiyappan, R, Cao, J, Velmurugan, G: Existence and uniform stability analysis of fractional-order complex-valued neural networks with time delays. IEEE Trans. Neural Netw. Learn. Syst. 26, 84-97 (2015)
Velmurugan, G, Rakkiyappan, R, Vembarasan, V, Cao, J, Alsaedi, A: Dissipativity and stability analysis of fractional-order complex-valued neural networks with time delay. Neural Netw. 86, 42-53 (2016)
Arik, S: Stability analysis of delayed neural networks. IEEE Trans. Circuits Syst. I 47, 1089-1092 (2000)
Wang, H, Yu, Y, Wen, G, Zhang, S: Stability analysis of fractional-order neural networks with time delay. Neural Process. Lett. 42, 479-500 (2015)
Hopfield, JJ, Tank, DW: Neural computation of decisions in optimization problems. Biol. Cybern. 52, 141-152 (1985)
Ding, Z, Shen, Y: Global dissipativity of fractional-order neural networks with time delays and discontinuous activations. Neurocomputing 196, 159-166 (2016)
Feng, C, Plamondon, R: On the stability analysis of delayed neural networks systems. Neural Netw. 14, 1181-1188 (2001)
Cao, J, Rakkiyappan, R, Maheswari, K, Chandrasekar, A: Exponential \(H_{\infty}\) filtering analysis for discrete-time switched neural networks with random delays using sojourn probabilities. Sci. China, Technol. Sci. 59, 387-402 (2016)
Li, R, Cao, J: Stability analysis of reaction-diffusion uncertain memristive neural networks with time-varying delays and leakage term. Appl. Math. Comput. 278, 54-69 (2016)
Cao, J, Li, R: Fixed-time synchronization of delayed memristor-based recurrent neural networks. Sci. China Inf. Sci. 60, 032201 (2017)
Chen, L, Qu, J, Chai, Y, Wu, R, Qi, G: Synchronization of a class of fractional-order chaotic neural networks. Entropy 15, 3265-3276 (2013)
Kriesel, D: A Brief Introduction on Neural Networks. Citeseer (2007)
Wang, Y, Li, T: Stability analysis of fractional-order nonlinear systems with delay. Math. Probl. Eng. 2014, Article ID 301235 (2014)
Xia, YS, Wang, J: A general projection neural network for solving monotone variational inequalities and related optimization problems. IEEE Trans. Neural Netw. 15, 318-328 (2004)
Huang, C, Cao, J: Active control strategy for synchronization and anti-synchronization of a fractional chaotic financial system. Phys. A, Stat. Mech. Appl. 473, 262-275 (2017)
Kaslik, E, Sivasundaram, S: Nonlinear dynamics and chaos in fractional-order neural networks. Neural Netw. 32, 245-256 (2012)
Huang, C, Cao, J, Xiao, M: Hybrid control on bifurcation for a delayed fractional gene regulatory network. Chaos Solitons Fractals 87, 19-29 (2016)
Nitta, T: Orthogonality of decision boundaries in complex-valued neural networks. Neural Comput. 16, 73-97 (2004)
Rakkiyappan, R, Velmurugan, G, Cao, J: Finite-time stability analysis of fractional-order complex-valued memristor-based neural networks with time delays. Nonlinear Dyn. 78, 2823-2836 (2014)
Rakkiyappan, R, Sivaranjani, K, Velmurugan, G: Passivity and passification of memristor-based complex-valued recurrent neural networks with interval time-varying delays. Neurocomputing 144, 391-407 (2014)
Zhao, H: Global asymptotic stability of Hopfield neural network involving distributed delays. Neural Netw. 17, 47-53 (2014)
O’Kelly, ME: Routing traffic at hub facilities. Netw. Spat. Econ. 10, 173-191 (2010)
Liu, C, Li, C, Huang, T, Li, C: Stability of Hopfield neural networks with time delays and variable-time impulses. Neural Comput. Appl. 22, 195-202 (2013)
Song, C, Cao, J, Liu, Y: Robust consensus of fractional-order multi-agent systems with positive real uncertainty via second-order neighbors information. Neurocomputing 165, 293-299 (2015)
Song, C, Cao, J: Dynamics in fractional-order neural networks. Neurocomputing 142, 494-498 (2014)
Velmurugan, G, Rakkiyappan, R, Cao, J: Further analysis of global μ-stability of complex-valued neural networks with unbounded time-varying delays. Neural Netw. 67, 14-27 (2015)
Chen, T: Global exponential stability of delayed Hopfield neural networks. Neural Netw. 14, 977-980 (2001)
Fang, Y, Kincaid, TG: Stability analysis of dynamical neural networks. IEEE Trans. Neural Netw. 7, 996-1006 (1996)
Liao, XF, Chen, G, Sanchez, EN: LMI-based approach for asymptotically stability analysis of delayed neural networks. IEEE Trans. Circuits Syst. I 49, 1033-1039 (2002)
Yu, W, Cao, J: Stability and Hopf bifurcation analysis on a four-neuron BAM neural network with time delays. Phys. Lett. A 351, 64-78 (2006)
Huang, C, Cao, J, Ma, Z: Delay-induced bifurcation in a tri-neuron fractional neural network. Int. J. Inf. Syst. Sci. 47, 3668-3677 (2016)
Xiao, M, Zheng, WX, Jiang, G, Cao, J: Undamped oscillations generated by Hopf bifurcations in fractional-order recurrent neural networks with Caputo derivative. IEEE Trans. Neural Netw. Learn. Syst. 12, 3201-3214 (2015)
Zhang, J, Jin, X: Global stability analysis in delayed Hopfield neural network models. Neural Netw. 13, 745-753 (2000)
Cao, J, Xiao, M: Stability and Hopf bifurcation in a simplified BAM neural network with two time delays. IEEE Trans. Neural Netw. 18, 416-430 (2007)
Hu, H, Huang, L: Stability and Hopf bifurcation analysis on a ring of four neurons with delays. Appl. Math. Comput. 213, 587-599 (2009)
Li, X, Wei, J: On the zeros of a fourth degree exponential polynomial with applications to a neural network model with delays. Chaos Solitons Fractals 26, 519-526 (2005)
Wei, J, Yuan, Y: Synchronized Hopf bifurcation analysis in a neural network model with delays. J. Math. Anal. Appl. 312, 205-229 (2005)
Xu, W, Hayat, T, Cao, J, Xiao, M: Hopf bifurcation control for a fluid flow model of Internet congestion control systems via state feedback. IMA J. Math. Control Inf. 33, 69-93 (2016)
Huang, C, Meng, Y, Cao, J, Alsaedi, A, Alsaadi, FE: New bifurcation results for fractional BAM neural network with leakage delay. Chaos Solitons Fractals 100, 31-44 (2017)
Rakkiyappan, R, Velmurugan, G, Cao, J: Stability analysis of fractional-order complex-valued neural networks with time delays. Chaos Solitons Fractals 78, 297-316 (2015)
Acknowledgements
This work was supported by CSIR research project No.25(0237)/14/EMR-II.
Author information
Authors and Affiliations
Corresponding authors
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
All authors contributed equally and significantly in writing this article. All authors read and approved the final manuscript.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Rakkiyappan, R., Udhayakumar, K., Velmurugan, G. et al. Stability and Hopf bifurcation analysis of fractional-order complex-valued neural networks with time delays. Adv Differ Equ 2017, 225 (2017). https://doi.org/10.1186/s13662-017-1266-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13662-017-1266-3