Higher difference structure of some discrete processes
Advances in Difference Equations volume 2012, Article number: 202 (2012)
A method for analyzing discrete processes based on consideration of their higher difference structure is presented. Two kinds of processes, deterministic systems (discrete dynamical systems) and the sequences of random binary independent variables, are considered. Two main statements, computation of higher absolute differences and restoring the original by a given higher order difference image, are studied. Some applications to dynamical systems are given.
MSC:39B12, 39A50, 37E05.
This paper presents some results on difference analysis, which is a method for studying irregular time series and orbits of discrete dynamical systems. Such an analysis, suggested in [1–3], is based on consideration of higher absolute differences taken from successive terms of a given time series or orbits of a given system. This is motivated by an observation that some natural systems (e.g., the visual cortex, ) process the information contained in signals difference structure. The difference analysis reveals some new aspects of nonlinearity; for instance, a difference analog for Lyapunov exponent , used for chaos discrimination, is introduced .
The content of this paper is as follows. In Section 2 deterministic processes are considered, Section 3 deals with random independent binary processes. In both cases, we are interested in computation of higher order absolute differences, recovering the original by a given difference image as well as in the limiting behavior of difference processes. Section 4 contains the proofs of results presented.
2 Deterministic processes
This section considers higher absolute differences taken from successive terms of discrete deterministic systems. Two main problems, computation of higher differences and restoring the original, are studied. Some applications to discrete dynamical systems are given.
2.1 Higher absolute differences of deterministic processes
In difference analysis, a given time series or an orbit X is decomposed into two constituents: the sign component S and the magnitude (or height) component H. The S-component reflects the alternation in monotony (increase/decrease) of higher order absolute differences taken from successive terms of X. The component S does not depend on the very exact values of these differences, while the component H consists of these absolute differences and does not depend on their sign distribution. At every step (associated with the order of differences) of the decomposition process, the orbit X can be completely restored by first terms of X and the two components. Since the behavior of X at infinity is determined by the limiting behavior of its S- and H-components, such an analysis can also be useful in dynamical systems (see, e.g., ).
Let us present some formal definitions. Let X be some infinite numerical sequence
This can be some time series, experimental data, or an orbit of iterates of some one-dimensional map. We consider the consecutive absolute differences,
define (m th order) difference sequence, (), and consider binary sequences
In this way, a given time series X is decomposed into two other, the sign and magnitude components and . We call and the m th S- and H-components of X, respectively, and denote , , and .
In this paper, we are mostly interested in behavior of H-components. Equation (2) is the basic one for studying the H-component: due to this equation, for most cases, any property of series () implies the same property of every series with . For instance, it follows that if for some (for some ) the limit
exists, then for every (for every ) the limit () also exists.
The following theorem asserts that every absolute difference is a linear form of the original X and presents a formula for its computation. The rule (5) below is a generalization of the well-known additive scheme for constructing the Pascal triangle of binomial coefficients. This theorem is a consequence of relations (2); the proof (conducted by induction) is straightforward and is omitted.
Theorem 2.1 For every time series (1) the can be computed by the formula
where the coefficients are constructed recurrently: for
2.2 Restoring the original by difference image
At every m th step (associated with the order m of differences) of the decomposition process, the original time series can be completely restored by its first m entries and the two components S and H. Indeed, the following theorem provides us with analytical expressions for computation of the original X by the components , and first m terms (below, it is denoted ):
Theorem 2.2 Let be given, be some infinite numerical sequence, and , , be some infinite binary sequences. Let be defined as follows: are arbitrary and for every natural
where if and are constructed recurrently: for
Then for all the relations
We note that Eq. (7) represents a countable infinite system of higher order difference equations (which are nonlinear since we deal with absolute differences) and its solution by Eq. (6) is given. The proof of this theorem is straightforward (by induction) and is omitted.
2.3 Application to dynamical systems
We consider the orbits of the maps f defined on the unit segment and the limiting (as the order m of differences tends to +∞) behavior of their difference series . We claim that this behavior is mainly due to some function ℋ () which can be determined as a solution to some difference-functional equation.
Let be a map defined on the numerical segment I and X be an orbit,
that is, we put in (1) , where (, ), denote the iterates of the map f. Theorem 2.1 yields that is some ‘iterate polynomial’,
where and . Let denote the collection of such , for each of which is convergent as . Therefore, one can consider the following limiting function ℋ () defined on :
ℋ, being defined through the magnitude orbit , reflects also the behavior at infinity of every n th series . Indeed, it follows from (2) that, for and every , is also found in (i.e., for all ). Then since , it follows that
The next statement presents a difference equation for computation of the limiting function ℋ and establishes the special property of such functions: once vanished, ℋ remains zero on all the further orbit of the map f. In the following two statements, denotes the entire part of number a (maximal integer which does not exceed a) and is its fractional part.
Theorem 2.3 For functions ℋ defined by Eq. (9), the following statements are true:
The function ℋ satisfies the following functional equation:(10)
If for some we have , then for all .
If for some we have , then there is a number N, such that
The proof of this theorem is straightforward: the point (1) of theorem is a consequence of Eq. (2) and points (2) and (3) follow directly from the point (1).
Particularly, this theorem immediately implies the following.
Corollary 2.4 Let, for some , the semi-orbit
be infinite. Then for all large enough .
For instance, if f is such that (e.g., this can be the so-called 4-logistic map or Bernoulli shift studied in deterministic chaos [5, 6]) and , then for every the semi-orbit (11) is infinite and hence, by Corollary 2.4, for such f, ℋ is identically zero on every periodic orbit: if , then for every . Particularly, it follows that if is such that and is dense on I, then the null-set is also dense on I.
3 Random independent discrete processes
This section considers the higher absolute differences taken from successive terms of random independent binary sequences (see also ). The same two problems as in Section 2, computation of higher order absolute differences and restoring the original, are studied. When proving Theorem 3.2, we underline some connections of difference analysis with discrete models of self-organized criticality (SOC), a physics-originated theory (e.g., [8, 9]) which studies the large systems of interacting microsystems.
3.1 Higher absolute differences of random binary processes
Let ξ be a discrete binary random independent process
(the variables are independent and take binary values 0 and 1 with some positive probabilities). The absolute differences
also take binary values with some positive probabilities, and hence one can consider the random difference processes assuming their independence. For a binary variable ξ, we assign the distribution of probabilities in the form , where and . We denote and characterize a variable ξ by the corresponding number . We notice that since , determines a variable ξ uniquely only when ξ is equidistributed, i.e., . In the following, we consider the binary version ℙ of the Pascal triangle of binomial coefficients, (; ), where every k th line () of ℙ is defined by relations
The following Theorem 3.1 is an analog for Theorem 2.1. To demonstrate the analogy, instead of , we use and denote and ().
Theorem 3.1 For every process (12), can be computed by the formula
where the coefficients are the terms of kth line of the triangle ℙ.
3.2 Restoring the original by difference image
The following problem is studied: given natural and a random sequence to determine a random process for which the relation holds. We give a solution assuming that processes ξ and , are independent. Based on Theorem 3.1 and defining random sequences by their distributions , our task is reduced to the following: given and a numerical sequence , to determine the positive numbers for which the relations
for hold. The solution to this task is given by Theorem 3.2 which is an analog for Theorem 2.2. The proof of Theorem 3.2 is conducted by involving some physics-related notions such as particles, energy, etc. Particularly, this allows us to demonstrate some connections of the difference analysis with a modification of some SOC-related models.
Let denote the number of nonzero on k th line of the triangle ℙ. We assume that such are numbered in increasing order of the index i: , where and let us denote . Thus, a number and two ordered samples,
correspond to a given k. Equation (14) means that our task is reduced to solving some countable system of linear algebraic equations; since, for every i which is not contained in the sample s from Eq. (15), we have , the system of equations (14) coincides with the system (16) below.
In the next formulation, for a positive number a, denotes the entire part of a (maximal integer which does not exceed a), and for natural a and b, we denote , where r is residual from dividing a by b (and if ).
Theorem 3.2 Let be given, , and and be defined by Eq. (15). Let us consider the system of linear algebraic equations
(where and are free terms) and define the numbers as follows:
are positive and arbitrary, and for , is equal to(17)
for , is equal to(18)
Then, for every , the sample satisfies Eq. (16).
It can be noticed from formulation of this theorem that the sought (whose index m is given as ) are such that are positive and arbitrary, while for , we have ; that is, the above-mentioned restored process ξ is not unique but depends on k arbitrary positive numerical parameters.
To prove Theorem 3.2, we use the following physics-related model, which can be treated as a modification of some lattice models (e.g., the BTW-model, ) of SOC. Let us describe the model that we use. Let, for , be a lattice from . At every moment of discrete time at the vertices of , which are found above the diagonal L connecting the vertices and , some material particles with positive or negative mass (or charge) are situated. Each particle performs uniform rectilinear motion with the unit speed on the vertical segments connecting the vertices and () of . At the (initial) moment , all the particles are found on L and possess the unit mass. Each moment t, when a number (=p) of particles reach simultaneously the upper side of the lattice (one can see that such particles should possess the same mass m), these particles disappear, and at the next moment , at every position on L a new particle of the mass emerges (and the motion of particles continues). In SOC terminology, the p particles hit the threshold (the upper side of the square ), and an avalanche of intensity p at the moment t in the system S of the moving particles occurs.
We consider a function (a potential) defined on the upper triangle which depends only on the coordinate y, . Our task related to the above-presented model is to compute the potential energy
of the system S of particles on for every moment t; here, and denote the y-coordinate and mass of the particle which at the moment t is found at the vertex . The proof of Theorem 3.2 is based on the following lemma.
Lemma 3.3 For every , the total (potential) energy of the system S can be computed by the formula
4 Proof of results
Proof of Theorem 3.1 Let , , and we consider the polynomials
where summation is extended over all binary samples of length m. If for one considers the polynomials (the sum of binary variables is understood as the sum by )
then denoting it follows that for ,
Indeed, we have , which yields Eq. (21). This implies that, for and , the identity
(it is assumed that ) holds.
On the other hand, one can prove (we omit the proof which can be conducted by the induction method) that for and ,
where it is denoted . Then the independence of the processes that we assumed implies
Denoting , () and (see Eq. (15)), one obtains
Proof of Lemma 3.3 For the case of a single particle with the (initial) mass equal to −1 moving on a vertical segment connecting the vertices and () of , one can compute that
That is, for every t, the energy of a single particle moving on is equal to
Considering the case of many particles, we note that on any segment a new particle in the system at a moment t emerges if and only if t is of the form (for some and some ). For particles that emerged as a result of attainment of the threshold during the motion on , the coordinate and mass are computed by (23); for particles that emerged on as a result of attainment of the threshold during the motion on some , , the coordinate and mass are computed by the same formula (23) but in a ‘shifted’ time: . Therefore, for the total energy of the particles situated on a given vertical segment , one obtains
Hence, for every t, the total energy of all the particles in the system S is equal to
Proof of Theorem 3.2 Since , Eq. (16) can be re-written as
Let us denote . One can see that and and then Eq. (26) can be re-written as follows:
and (for )
One can see that (27) coincides with the point (1) of the theorem, and this point of the theorem is proved.
We base the proof of the point (2) of the theorem on the above-defined lattice model and use the Gauss substitution method for solving linear systems. With each variable of the form , where and (cf. Eq. (27)), we associate a particle which is found on m th vertical segment of length in the upper triangle of (and if m is fixed, the index n enumerates a particle’s position on this segment). Equations (27) and (28) and the substitution method assign the following dynamics of index (and the corresponding particles) with respect to variable p: if this index does not exceed k (that is, the corresponding particle is found in the lattice ) then p increases, and if in some equation from the system (28) it appears that for some p and m the inequality holds, then the variable in this equation is replaced (according to the corresponding equation in (27)) by the sum
In terms of the lattice model, the inequality is interpreted as the threshold attainment and the substitution of is interpreted as an event of emergence of new particles on each of positions of the diagonal L. One can see that if this variable substitution procedure is sequently applied to all the equations in the system (28), we obtain the above-defined lattice model of moving particles. Then, by applying Lemma 3.3 (where the time variable t coincides with the variable T in Eq. (28)) and assuming that the potential U (Section 3.2) is assigned as , we obtain the sought Eq. (18). Theorem 3.2 is proved. □
Shahverdian AY, Apkarian AV: On irregular behavior of neuron spike trains. Fractals 1999, 7: 93–103. 10.1142/S0218348X99000116
Shahverdian AY: A finite-difference method for analyzing one-dimensional nonlinear systems. Fractals 2000, 8: 49–65.
Shahverdian AY, Apkarian AV: A difference characteristic for one-dimensional nonlinear systems. Commun. Nonlinear Sci. Numer. Simul. 2007, 12: 233–242. 10.1016/j.cnsns.2005.02.004
Miller KD 3. In Models of Neural Networks. Edited by: Domany E, Hemmen JL, Schulten K. Springer, New York; 1996.
Schuster HG: Deterministic Chaos. Physik-Verlag, Weinheim; 1984.
Sharkovsky AN, Maisterenko YL, Romanenko EY: Difference Equations and Applications. Nauka, Kiev; 1986.
Shahverdian AY: Minimal Lie algebra, fine limits, and dynamical systems. Reports of Armenian Natl. Acad. Sci. 2012, 112: 160–169.
Shahverdian AY, Apkarian AV: Avalanches in networks of weakly coupled phase-shifting rotators. Commun. Math. Sci. 2008, 6: 217–234.
Bak P, Tang C, Wiesenfeld K:Self-organized criticality: an explanation of noise. Phys. Rev. Lett. 1987, 59: 381–384. 10.1103/PhysRevLett.59.381
Authors thank the editing group for corrections in the linguistics of the manuscript.
The authors declare that they have no competing interests.
AYS participated in preparing the most part of the paper and the most part of statements and proofs. AK participated in the proof of Theorem 3.2, in the statements on random processes and drafted the manuscript. RBB participated in the statement of Theorem 2.3, proof of Lemma 3.3, preparing the text on SOC model, and drafted the manuscript. All authors read and approved the final manuscript.
About this article
Cite this article
Shahverdian, A., Kilicman, A. & Benosman, R. Higher difference structure of some discrete processes. Adv Differ Equ 2012, 202 (2012). https://doi.org/10.1186/1687-1847-2012-202
- higher differences
- discrete dynamical systems
- independent random processes