- Research
- Open Access
- Published:
Dynamic evolution evoked by external inputs in memristor-based wavelet neural networks with different memductance functions
Advances in Difference Equations volume 2013, Article number: 258 (2013)
Abstract
In this paper, we present a preliminary study concerning the dynamic flows in memristor-based wavelet neural networks with continuous feedback functions and discontinuous feedback functions in the presence of different memductance functions. The theoretical studies as well as the computer simulations confirm our claim. The analysis can characterize the fundamental electrical properties of memristor devices and provide convenience for applications.
1 Introduction
In the recent years, numerous studies focused on the use of the memristor as a discrete element in a circuit to model phenomena or to implement novel functions. Recent advances in memristor lead to the realization of large-scale artificial neural systems subserving perception, cognition, and learning [1–9]. Memristor acts as a modulating synapse interconnection between neurons; plasticity is accomplished through adjusting the memristance via current spikes based on the relative timings of pre-synaptic and postsynaptic neuron spikes. By using memristor as synapse in artificial neural systems, the potential in creating neuromorphic computing hardware through its variable memristance is unlimited.
As we all know, memristor-based neural networks may be a real breakthrough in the fields of electronic and circuit design [2–5]. Dynamic evolution of electronic circuits and systems is extremely important in systems analysis and integration. For this reason, it is important to study what dynamics arise in memristive systems and speculate about how they could be used for meaningful tasks. One question is, the neural network with memristor bridge synapse appears a plethora of complex nonlinear behaviors [5–9]. It is hard to predict the dynamic flows of a specific memristor-based neural network when it might become detrimental to performance, so a detailed analytical study of the dynamic evolution is necessary.
Consider the memristive neurodynamic system governed by the following equations
where is the voltage of the capacitor , denotes external input, is wavelet feedback function, represents memristor-based weights, and
in which denotes the memductance of memristor . And represents the memristor between the feedback function and .
Combining the physical structure of a memristor device, then one can see that
where and denote charge and magnetic flux corresponding to memristor , respectively.
Research shows the pinched hysteresis loops are the fingerprint of memristive devices [6, 9]. Under different pinched hysteresis loops, the evolutionary tendency or process of memristive systems evolves into different forms. It is generally known that the pinched hysteresis loop is due to the nonlinearity of memductance function. As two typical memductance functions, in this paper, we discuss the following two cases.
Case 1: The memductance function is given by
where , and are constants, .
Case 2: The memductance function is given by
where and are constants, .
According to the features of memristor given in case 1 and case 2, the following two cases can happen.
Case 1′: In case 1,
for , where and are constants.
Case 2′: In case 2,
for , where and are constants.
Clearly, the memristive neural network (1) with different memductance functions is a state-dependent switched system or a state-dependent continuous system, which is the generalization of those for conventional neural networks.
Several novel research results on conventional nonlinear neural networks have been reported, see [10–25]. Whereas in memristor-based neural networks, to study the dynamic flows of these systems, the classical approach on nonlinear systemic theory is invalid; since it consists of too many subsystems, it is too difficult to do so. It is also important to develop effective methods to process these issues concurrently with the development of applications, in order to allow the memristor-based neural networks to be readily used as the alternate approaches to the traditional techniques or as components of integrated systems.
In this paper, the main purpose is to make the attempt to deal with the dynamic flows for a class of memristor-based wavelet neural networks with continuous feedback functions and discontinuous feedback functions in the presence of different memductance functions. Meanwhile, the theoretical investigation would help to design efficient memristor-based neuromorphic circuits and study other memristor-based complex systems. Note that the structure of wavelet neural networks is totally different from many traditional neural networks. Hence, the existing results can not be directly applied to the wavelet neural networks. In addition, we give some sufficient conditions on dynamic evolution. All of these conditions are very easy to be verified.
Throughout this paper, solutions of all the systems considered in the following are intended in the Filippov’s sense. represents the interval. denotes closure of the convex hull of generated by real numbers and . Let , , , , for .
The remaining part of this paper is organized as follows. The main results are stated in Sections 2 and 3. In Section 4, two illustrative examples are provided with simulation results. Finally, concluding remarks are given in Section 5.
2 Memristor-based wavelet neural networks (1) in case 1′
In this section, we discuss the memristor-based wavelet neural networks (1) with continuous feedback functions and discontinuous feedback functions in case 1′.
Obviously, the memristor-based wavelet neural network (1) in case 1′ is a state-dependent switched system, which has nonsmooth dynamics.
2.1 Mexican-hat-type feedback functions
As the most typical representative of continuous feedback functions, Mexican-hat-type feedback functions possess a unique wavelet structure [18].
A solution (in the sense of Filippov) of system (1) with initial condition , is absolutely continuous on any compact interval of , and
In fact, it is easy to find that in case 1′, for ,
Obviously, for ,
Consider system (1) with a class of Mexican-hat-type feedback functions defined as
Figure 1 shows the configuration of (8).
Define three index subsets as follows:
Theorem 1 All the state components of system (1) with Mexican-hat-type feedback function (8) in case 1′, , will flow to the interval when .
Proof We deliver it in the following two cases due to the different location of .
Case A .
In this case, if there exists some such that , while for , then from (7),
Thus, would never get out of . Similarly, we can also get that once for some , then would stay in for all .
Case B .
In this case, we claim that would monotonously decrease until it reaches the interval in some finite time , i.e., .
As a matter of fact, when , from (7),
when , from (7),
when , from (7),
To sum up, wherever the initial state is located in, would flow to and enter the interval . Combining with Case A, would eventually stay in this interval . □
Theorem 2 All the state components of system (1) with Mexican-hat-type feedback function (8) in case 1′, , will flow to the interval when .
Proof According to the different location of , we deduce it in three cases.
Case A .
In this case, if there exists some such that , while for , then from (7),
Analogously, if there exists some such that , while for , then from (7),
Thus, would never get out of . Similarly, we can also get that once for some , then would stay in for all .
Case B .
When , from (7),
when , from (7),
Thus, in this case, would monotonously increase until it reaches .
Case C .
When , from (7),
Therefore, would monotonously decrease until it enters the interval .
To sum up, wherever the initial state is located in, would flow to and enter the interval . □
Theorem 3 All the state components of system (1) with Mexican-hat-type feedback function (8) in case 1′, , will flow to the interval when .
Proof Deliver it in the following two cases.
Case A .
In this case, if there exists some such that , while for , then from (7),
So, would never get out of . Similarly, we can also get that, once for some , then would stay in for all .
Case B .
In this case, we claim that would monotonously increase until it reaches the interval .
As a matter of fact, when , from (7),
when , from (7),
when , from (7),
Therefore, in this case, would monotonously increase until it reaches .
In summary, wherever the initial state is located in, would flow to and enter the interval . □
Remark 1 In Theorems 1-3, a core idea is to employ nonsmooth analysis within mathematical framework of the Filippov solution. Generally speaking, nonsmooth analysis is suitable for analyzing nonsmooth dynamics of hybrid systems. Meanwhile, it is worth observing that the memristor-based wavelet neural network model in case 1′ is a state-dependent nonlinear switching dynamical system, which extends many of the existing neural networks. Therefore, the obtained results in this paper can be used in the wider scope.
2.2 Piecewise constant feedback functions
As a representative of discontinuous feedback functions, piecewise constant feedback functions have an important position among typical wavelet neural networks [24, 25].
Consider system (1) with a class of piecewise constant feedback functions defined as
Figure 2 shows the configuration of (9).
Corollary 1 All the state components of system (1) with piecewise constant feedback function (9) in case 1′, , will flow to the interval when .
Corollary 2 All the state components of system (1) with piecewise constant feedback function (9) in case 1′, , will flow to the interval when .
Corollary 3 All the state components of system (1) with piecewise constant feedback function (9) in case 1′, , will flow to the interval when .
Corollaries 1-3 can be proved using standard arguments as Theorems 1-3.
Remark 2 Theorems 1-3 and Corollaries 1-3 are obtained based on Mexican-hat-type feedback function (8) and piecewise constant feedback function (9). In fact, even if memristive neurodynamic system (1) appears as other types of Mexican-hat-type feedback functions and piecewise constant feedback functions, the main results in this paper still can be made some parallel promotions.
3 Memristor-based wavelet neural networks (1) in case 2′
In this section, we investigate the memristor-based wavelet neural networks (1) with continuous feedback functions and discontinuous feedback functions in case 2′.
Obviously, the memristor-based wavelet neural network (1) in case 2′ is a state-dependent continuous system.
By (1), it is easy to know that for ,
Define three index subsets as follows:
Theorem 4 All the state components of system (1) with Mexican-hat-type feedback function (8) in case 2′, , will flow to the interval when .
Proof We deliver it in the following two cases due to the different location of .
Case A .
In this case, if there exists some such that , while for , then from (10),
Thus, would never get out of . Similarly, we can also get that once for some , then would stay in for all .
Case B .
In this case, we claim that would monotonously decrease until it reaches the interval in some finite time , i.e., .
As a matter of fact, when , from (10),
when , from (10),
when , from (10),
To sum up, wherever the initial state is located in, would flow to and enter the interval . Combining with Case A, would eventually stay in this interval . □
Theorem 5 All the state components of system (1) with Mexican-hat-type feedback function (8) in case 2′, , will flow to the interval when .
Proof According to the different location of , we deduce it in three cases.
Case A .
In this case, if there exists some such that , while for , then from (10),
Analogously, if there exists some such that , while for , then from (10),
Thus, would never get out of . Similarly, we can also get that once for some , then would stay in for all .
Case B .
When , from (10),
when , from (10),
Thus, in this case, would monotonously increase until it reaches .
Case C .
When , from (10),
Therefore, would monotonously decrease until it enters the interval .
To sum up, wherever the initial state is located in, would flow to and enter the interval . □
Theorem 6 All the state components of system (1) with Mexican-hat-type feedback function (8) in case 2′, , will flow to the interval when .
Proof Deliver it in the following two cases.
Case A .
In this case, if there exists some such that , while for , then from (10),
So would never get out of . Similarly, we can also get that once for some , then would stay in for all .
Case B .
In this case, we claim that would monotonously increase until it reaches the interval .
As a matter of fact, when , from (10),
when , from (10),
when , from (10),
Therefore, in this case, would monotonously increase until it reaches .
In summary, wherever the initial state is located in, would flow to and enter the interval . □
Corollary 4 All the state components of system (1) with piecewise constant feedback function (9) in case 2′, , will flow to the interval when .
Corollary 5 All the state components of system (1) with piecewise constant feedback function (9) in case 2′, , will flow to the interval when .
Corollary 6 All the state components of system (1) with piecewise constant feedback function (9) in case 2′, , will flow to the interval when .
Corollaries 4-6 can be proved using standard arguments as Theorems 4-6.
Remark 3 It is worth noting that memristive neural networks may display different types of dynamic features in the presence of different memductance functions, i.e., state-dependent switched system and state-dependent continuous system. Although the analytical method is based on two different theory architectures, the proposed criteria is very similar. The unified form of criterion is an effective methodology of enhancing the proposed criterion to be easily applied to different situations.
4 Illustrative examples
In this section, two examples are given to illustrate our results. Simulation results show that the obtained conclusions are valid.
Example 1 Consider the two-dimensional memristive neurodynamic system as follows:
where
Simulation results are described in Figures 3 and 4 when , , where the trajectories of system (11) with Mexican-hat-type feedback function (8) and piecewise constant feedback function (9) under different initial values are depicted. According to Theorems 1 and 3, Corollaries 1 and 3, the results of theoretical calculations are consistent with the experiments.
Example 2 Consider a two-dimensional memristive neurodynamic system described by
Simulation results are described in Figures 5 and 6 when , , where the trajectories of system (12) with Mexican-hat-type feedback function (8) and piecewise constant feedback function (9) under different initial values are showed. According to Theorem 6 and Corollary 6, the experiments perfectly match the theoretical results.
5 Concluding remarks
Rhythmicity represents one of most striking manifestations of dynamic behaviors in biological systems. Memristor-based neural networks have been shown to be capable of understanding of neural processes using memory devices. In this article, we give conditions to allow a dynamic orbit of memristor-based wavelet neural networks located in the designated region. The theoretical results are supplemented by simulation results in two illustrative examples.
References
Cantley KD, Subramaniam A, Stiegler HJ, Chapman RA, Vogel EM: Hebbian learning in spiking neural networks with nanocrystalline silicon TFTs and memristive synapses. IEEE Trans. Nanotechnol. 2011, 10(5):1066–1073.
Cantley KD, Subramaniam A, Stiegler HJ, Chapman RA, Vogel EM: Neural learning circuits utilizing nano-crystalline silicon transistors and memristors. IEEE Trans. Neural Netw. Learn. Syst. 2012, 23(4):565–573.
Itoh M, Chua LO: Memristor cellular automata and memristor discrete-time cellular neural networks. Int. J. Bifurc. Chaos 2009, 19(11):3605–3656. 10.1142/S0218127409025031
Kim H, Sah MP, Yang CJ, Roska T, Chua LO: Neural synaptic weighting with a pulse-based memristor circuit. IEEE Trans. Circuits Syst. I, Regul. Pap. 2012, 59(1):148–158.
Pershin YV, Di Ventra M: Experimental demonstration of associative memory with memristive neural networks. Neural Netw. 2010, 23(7):881–886. 10.1016/j.neunet.2010.05.001
Wen SP, Zeng ZG: Dynamics analysis of a class of memristor-based recurrent networks with time-varying delays in the presence of strong external stimuli. Neural Process. Lett. 2012, 35(1):47–59. 10.1007/s11063-011-9203-z
Wu AL, Zeng ZG: Exponential stabilization of memristive neural networks with time delays. IEEE Trans. Neural Netw. Learn. Syst. 2012, 23(12):1919–1929.
Wu AL, Zeng ZG: Dynamic behaviors of memristor-based recurrent neural networks with time-varying delays. Neural Netw. 2012, 36: 1–10.
Wu AL, Zeng ZG: Anti-synchronization control of a class of memristive recurrent neural networks. Commun. Nonlinear Sci. Numer. Simul. 2013, 18(2):373–385. 10.1016/j.cnsns.2012.07.005
Huang TW: Robust stability of delayed fuzzy Cohen-Grossberg neural networks. Comput. Math. Appl. 2011, 61(8):2247–2250.
Huang TW, Li CD, Duan SK, Starzyk JA: Robust exponential stability of uncertain delayed neural networks with stochastic perturbation and impulse effects. IEEE Trans. Neural Netw. Learn. Syst. 2012, 23(6):866–875.
Jiang F, Shen Y: Stability in the numerical simulation of stochastic delayed Hopfield neural networks. Neural Comput. Appl. 2013, 22(7–8):1493–1498. 10.1007/s00521-012-0935-0
Jiang F, Yang H, Shen Y: On the robustness of global exponential stability for hybrid neural networks with noise and delay perturbations. Neural Comput. Appl. 2013. 10.1007/s00521-013-1374-2
Shen Y, Wang J: Almost sure exponential stability of recurrent neural networks with Markovian switching. IEEE Trans. Neural Netw. 2009, 20(5):840–855.
Shen Y, Wang J: Robustness analysis of global exponential stability of recurrent neural networks in the presence of time delays and random disturbances. IEEE Trans. Neural Netw. Learn. Syst. 2012, 23(1):87–96.
Song XG, Gao HB, Ding L, Liu DY, Hao MH: The globally asymptotic stability analysis for a class of recurrent neural networks with delays. Neural Comput. Appl. 2013, 22(3–4):587–595. 10.1007/s00521-012-0888-3
Gao HB, Song XG, Ding L, Liu DY, Hao MH: New conditions for global exponential stability of continuous-time neural networks with delays. Neural Comput. Appl. 2013, 22(1):41–48. 10.1007/s00521-011-0745-9
Wang LL, Chen TP: Multistability of neural networks with Mexican-hat-type activation functions. IEEE Trans. Neural Netw. Learn. Syst. 2012, 23(11):1816–1826.
Yu W, Francisco PC, Li XO: Two-stage neural sliding mode control of magnetic levitation in minimal invasive surgery. Neural Comput. Appl. 2011, 20(8):1141–1147. 10.1007/s00521-010-0477-2
Yu W, Li XO: Automated nonlinear system modeling with multiple fuzzy neural networks and kernel smoothing. Int. J. Neural Syst. 2010, 20(5):429–435. 10.1142/S0129065710002516
Zhang HG, Liu JH, Ma DZ, Wang ZS: Data-core-based fuzzy min-max neural network for pattern classification. IEEE Trans. Neural Netw. 2011, 22(12):2339–2352.
Zhang HG, Ma TD, Huang GB, Wang ZL: Robust global exponential synchronization of uncertain chaotic delayed neural networks via dual-stage impulsive control. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 2010, 40(3):831–844.
Zhang HG, Wang YC: Stability analysis of Markovian jumping stochastic Cohen-Grossberg neural networks with mixed time delays. IEEE Trans. Neural Netw. 2008, 19(2):366–370.
Bao G, Zeng ZG: Analysis and design of associative memories based on recurrent neural network with discontinuous activation functions. Neurocomputing 2012, 77(1):101–107. 10.1016/j.neucom.2011.08.026
Huang YJ, Zhang HG, Wang ZS: Multistability and multiperiodicity of delayed bidirectional associative memory neural networks with discontinuous activation functions. Appl. Math. Comput. 2012, 219(3):899–910. 10.1016/j.amc.2012.06.068
Acknowledgements
The work is supported by the Natural Science Foundation of China under Grant 61304057, the 973 Program of China under Grant 2011CB710606. The work of AW was done with the School of Automation, Huazhong University of Science and Technology, Wuhan, China.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
AW carried out the main results of this article and drafted the manuscript. ZZ directed the study and helped with the inspection. JX proposed the understanding about memristive neural networks, which helped in improving the paper quality. All the authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Wu, A., Zeng, Z. & Xiao, J. Dynamic evolution evoked by external inputs in memristor-based wavelet neural networks with different memductance functions. Adv Differ Equ 2013, 258 (2013). https://doi.org/10.1186/1687-1847-2013-258
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1687-1847-2013-258
Keywords
- memristor
- wavelet neural networks
- dynamics