- Open Access
Ordered dynamics in biased and cooperative Boolean networks
Advances in Difference Equations volume 2013, Article number: 313 (2013)
This paper contributes to the theoretical analysis of the qualitative behavior of two types of Boolean networks: biased and cooperative ones. A Boolean network is biased if at least a specified fraction of its regulatory functions returns one Boolean value more often than the other and is cooperative if there are no negative interactions between the variables. We prove nontrivial upper bounds on the maximum length of periodic orbits in such networks under the assumption that the maximum number of inputs and outputs per node is a fixed constant r. For the case of n-dimensional networks with in which only AND and OR are allowed, we find an upper bound of , which is asymptotically optimal in view of previously published counterexamples. The theoretical results are supplemented by simulations of the generic behavior of cooperative networks which indicate that for large indegrees, trajectories tend to converge rapidly towards a steady state or a small periodic orbit. The latter starkly contrasts with the behavior of random arbitrary Boolean networks.
MSC: 05A15, 06A07, 34C12, 39A33, 94C10, 92C42.
Mathematical models of biological problems have become increasingly sophisticated with the advent of new quantitative techniques. Models involving dozens of proteins at the cell level abound in the literature [1, 2], mostly created using continuous methods. An interesting counterpart to continuous systems are Boolean networks, characterized by discrete time dynamics and the existence of only two possible states (0 and 1) for each variable at any given time . In the face of parameter uncertainty, modeling using Boolean networks can produce qualitative predictions at the right level of detail for many applications.
This paper continues a line of theoretical research exploring the qualitative behavior of so-called cooperative Boolean networks. This concept corresponds to systems that have exclusively positive interactions among their variables, and in particular are monotone, which means that they have only positive feedback loops. Such networks have been proposed as important tools for gaining insight into the dynamics of gene regulatory and other biological networks . In the case of systems with at most two inputs for each variable, a cooperative Boolean network can only have constant, AND, OR and COPY regulatory functions. The continuous counterpart of this definition has been studied extensively , and under mild conditions the generic trajectory of a continuous cooperative system is guaranteed to converge towards the set of equilibria.
Much of the literature on the dynamics of Boolean networks has focused on the study of so-called random Boolean networks or RBNs, where an n-dimensional Boolean network is randomly drawn from the class of all such networks with a maximum of r inputs per node. For , the trajectory of a randomly chosen initial state tends to reach a periodic orbit whose size scales exponentially in n. Such long orbits are considered a hallmark of chaotic dynamics. Another hallmark of chaotic dynamics is sensitivity to initial conditions. This can be conceptualized in a variety of ways, for example, in terms of p-instability, as defined at the end of Section 2. A third hallmark of chaos are relatively few or no eventually frozen nodes, that is, nodes whose state will change only finitely often during the trajectory. These hallmarks usually, but not always, go together. It is a matter of judgement which hallmarks are deemed necessary for considering the dynamics truly chaotic; see  for examples and further discussion on this point. In terms of these hallmarks, the dynamics of RBNs tends to become, on average, more chaotic as r is increased or if the average bias of the regulatory functions, defined as the difference between 0.5 and the proportion of input vectors on which it takes the Boolean value 1, decreases. For surveys of these and related results, see [7–9].
In Section 6 we briefly explore the analogue for cooperative Boolean networks. That is, for we simulate the trajectories of randomly chosen initial states in Boolean networks that are randomly chosen from the class of all cooperative Boolean networks with at most r inputs per node. We find that for trajectories tend to reach a steady state or a very small periodic orbit after a few steps, and this pattern appears to be stronger for larger r and n. We also give an argument in support of a conjecture that if there is no restriction on the number of inputs, for sufficiently large n, the vast majority of the trajectories will reach either of the steady-state vectors or . Thus, on average, random cooperative Boolean networks tend to have much shorter periodic orbits than corresponding RBNs, and in contrast to the latter, their dynamics appears to become less chaotic, at least in terms of lengths of periodic orbits that are reached from random initial conditions and the proportion of eventually frozen nodes, as the number r of allowed inputs per node increases.
These observations about average behavior naturally lead to the question whether there exist provable and nontrivial upper bounds on the length of periodic orbits, or at least on the median length of periodic orbits, that will be reached from randomly drawn initial conditions. Since the state space of an n-dimensional Boolean network has size , a bound might be considered nontrivial if it does not exceed for some constant .
If only the maximal number of inputs and outputs per node is restricted, even to 2, then no such bound can be derived; nice examples are already given in [10, 11]. On the other hand, very stringent upper bounds can be derived for some very special classes of networks, such as the XOR Boolean networks [12, 13], or the class of networks that are allowed to use only AND-operators or OR-operators, but not both .
For cooperative Boolean networks, the situation is more subtle. The maximum possible size of any periodic orbit in such networks is known to be , which by Stirling’s formula scales like , faster than for any [4, 15, 16]. It has previously been shown that if in addition to requiring cooperativity we restrict the maximum number r of inputs and the number of outputs per node, then nontrivial upper bounds on the (maximal or even median) lengths of periodic orbits still do not exist, even for (see Theorem 1 below, which summarizes some results from [6, 17–19]). However, for , the constructions used in the proof of this theorem give systems in which the vast majority of variables take just one input, that is, their regulatory function is COPY. Note that while COPY is an unbiased function, both AND and OR are biased. For example, binary AND returns 1 for only one quarter of its inputs. In other words, for every , most constructions used for the proof of Theorem 1 give Boolean systems in which a proportion of more than of all regulatory functions are unbiased.
In contrast, suitable assumptions on the amount of bias do imply nontrivial upper bounds on the possible lengths of periodic orbits. Our main result, Theorem 2, shows that upper bounds of the form for some on the lengths of periodic orbits exist under the assumption of fixed bounds on the minimal proportion of biased regulatory functions and the maximal number of inputs and outputs per node. In particular, this result applies to cooperative Boolean networks with a fixed minimal proportion of binary AND or binary OR regulatory functions. By Theorem 1(ii), an upper bound on the number of inputs alone is not sufficient in this type of result. For , if the proportion of biased regulatory functions is 1, then we can take , which is optimal in view of Theorem 1(iii).
Even more stringent bounds apply in some cases if we additionally require a certain amount of sensitivity to initial conditions. Theorem 4 gives upper bounds for the case when all regulatory functions take exactly two inputs and are biased. It implies upper bounds on the lengths of the form for any in systems of this form that are p-unstable for p sufficiently close to 1. By Theorem 3.10 of , the latter bound is asymptotically optimal. Note that in contrast to Theorem 2, no upper bound on the number of outputs per node is required in Theorem 4.
Preliminary versions of the proofs given in Sections 3-5 were posted in the preprint . One purpose of this paper is to make streamlined and more easily readable versions of these arguments available in peer-reviewed journal form. The material in Section 6 is entirely new.
An n-dimensional Boolean network consists of a state space , together with a time evolution map . Each individual component is called the k th regulatory function, and a trajectory of the system is a function such that for every . Since the state space is finite, each trajectory must eventually become periodic. The set of states in the periodic part of the trajectory will be called a periodic orbit. Periodic orbits that are reached from a given initial condition are often called attractors or limit cycles of the trajectory in the literature. The basin of attraction of a given periodic orbit is the set of all initial conditions from which the orbit is reached.
Define the partial order ≤ on Π by if for every i. A regulatory function is cooperative if implies . A Boolean network is cooperative if each of its regulatory functions is cooperative, i.e., if implies . An equivalent definition can be obtained by requiring that each regulatory function can be written as a composition of Boolean functions that use only the operators AND and OR with one or more inputs. Since the negation operator is not needed, cooperative Boolean networks are exactly the ones without negative interactions.
We define a -Boolean network as a system in which each regulatory function actually depends on at most r inputs, and each variable has at most b outputs (i.e., it affects the dynamics of at most b other variables). If , we call the system quadratic; a -system is called bi-quadratic. A regulatory function that depends on only one variable is called monic; a non-monic quadratic regulatory function is called strictly quadratic. A Boolean network with only quadratic regulatory functions will be called a strictly quadratic network. Notice that in a strictly quadratic, bi-quadratic network every variable must have exactly two inputs and two outputs.
An n-dimensional Boolean network is said to be c-chaotic, for , if it has a periodic orbit of length at least . If a periodic orbit of this length is reached from a proportion of at least p initial conditions, then the system is called p-c-chaotic.
The bias Λ of a regulatory function is the fraction of input vectors for which the function outputs 1. If , we say that is unbiased; if , we say that is biased. For , we say that a Boolean system is α-biased if a proportion of at least α of its regulatory functions consists of biased functions. Note that this last definition neither distinguishes between bias towards 0 or 1 nor all by itself implies how strong the bias is.
A Boolean system is p-unstable if a random single-bit flip in a randomly chosen initial state moves the trajectory into the basin of attraction of a different periodic orbit with probability at least p. Let us call a Boolean system p-1-unstable if a random single-bit flip in a randomly chosen initial state results in a different state after one updating step with probability at least p (even if the new and old trajectories might merge after several updating steps). Thus every p-unstable Boolean system must be p-1-unstable, but not vice versa.
3 Bounds on the length of periodic orbits
For easier reference, let us quote the following result.
Theorem 1 Let c, , p be constants with and . Then, for all sufficiently large n, there exist n-dimensional cooperative Boolean networks that are, respectively:
bi-quadratic and p-c-chaotic,
strictly quadratic and p-c-chaotic,
strictly quadratic, bi-quadratic and p--chaotic.
Versions for c-chaos instead of p-c-chaos were proved in [17, 18]; point (i) in the form quoted here was proved in ; point (ii) in the form quoted here was proved in , and (iii) as quoted here is an easy consequence of the constructions in [17, 19]. Theorem 1 sets the stage for the main result of this paper.
Theorem 2 Let , and let b, r be positive integers. Then there exists a positive constant such that for every and sufficiently large n, there is no c-chaotic, n-dimensional, α-biased -Boolean system. In particular, for every and sufficiently large n, every c-chaotic, n-dimensional cooperative -Boolean system uses COPY for more than of its regulatory functions.
Proof We will prove only the first part of the theorem; the second part then follows from the observation that the only nonconstant cooperative unbiased Boolean function that takes at most two inputs is the COPY function.
Fix α, b, r as in the assumptions, and let be an n-dimensional -Boolean system. Assume that at least αn of the regulatory functions are biased.
Let be a sequence of (not necessarily pairwise distinct) elements of . If the elements of happen to be pairwise distinct, then we will speak of being a subset of Π. Let and consider the ratio
More generally, let and . For v-element subsets of with , we define ratios as follows:
One can think of as a measure of the bias of the sequence on the set I. Notice that implies for all nonempty subsets J of I, and in particular that for all . □
If is randomly chosen, then for i, I as above the expected values are and . Thus if is sufficiently large, one should be able to choose a subset with , and arbitrarily close to 1. The following lemma shows that periodic orbits in are far from random in this respect.
Lemma 1 There exists such that for all as above, all biased , all periodic orbits of and all subsets with , it holds that for .
Proof Let be such that for each of the finitely many biased Boolean functions with domain , we have . Let be small enough that . Choose as in the assumption and assume wlog that ; the proof in the case when is symmetric. Let J be the domain of , and let .
Consider a subset of a periodic orbit with . As we mentioned in the discussion that follows (1), if , then also and there is nothing to prove. So assume that . Then all possible input vectors for appear in exactly equal proportion in , and it follows that . The following inequalities show that in this case , which implies .
and the inequality follows. This in particular implies . □
Let , let , and let D be a family of pairwise disjoint subsets of size each with . We say that is β-τ-balanced for D if there exist and with such that , and that is β-τ-balanced if it is β-τ-balanced for every such D.
Lemma 2 There exists a constant such that for τ as in Lemma 1, no periodic orbit of can be β-τ-balanced.
Proof For each , let . Since is a -Boolean system, for each such there exist at most other with . A recursive construction allows us to find pairwise disjoint sets corresponding to biased functions . That is, for , there exists a family D of pairwise disjoint subsets of size each, with , such that each set in D is of the form for some biased . By Lemma 1, this family witnesses that no periodic orbit of can be β-τ-balanced. □
Now Theorem 2 becomes a consequence of the following result.
Lemma 3 Let . Then there exists a constant such that for sufficiently large n, every subset of of size is β-τ-balanced.
Proof Let β, τ be as in the assumptions and assume throughout this argument that n is a sufficiently large positive integer. Let . Consider an arbitrary family D of pairwise disjoint subsets I of with and for each .
The proof proceeds in three stages. First we will define, for , random variables . Next we will show that if there exists any subset of size that is not β-τ-balanced for D, then
In the third stage we will complete the proof by showing that for c sufficiently close to 2, inequality (2) fails.
Stage 1: Defining
Fix c with and consider the space of all sequences of randomly and independently (with replacement) chosen states in of length .
Consider with and a fixed . Note that . We will treat and as random variables and usually suppress their dependence on in our notation. We define
Stage 2: Nonbalanced sets imply (2)
Consider the following procedure for randomly drawing a subset of of size : First draw a sequence as in Stage 1. Then the set associated to the sequence has size , where is a random variable that represents the number of in that duplicate an earlier term in the sequence. Form by adding a randomly chosen subset of of size N to . By symmetry, this gives the uniform distribution, and moreover, for any given M with , the conditional probability of any potential outcome is still uniform, that is,
The expected value of N can be estimated as
In particular, we can assume . Now it follows from (4) and Markov’s inequality
that we can assume
Now assume that there is any subset of size that is not β-τ-balanced for D, and suppose that exists for which and . Consider . If , then , and for each , we can find of size such that for each . These sets are pairwise disjoint, and their union satisfies . Moreover, . This would contradict the assumption that was not β-τ-balanced for D. Thus we must have , that is, . Now
and (2) follows from (3) and (5).
Stage 3: Inequality (2) fails for sufficiently large c
Consider with and . Recall that . We want to estimate the probability . Note that is the mean of independent random variables that take values in . Thus Hoeffding’s inequality  applies, and we get
where , which in turn implies that . Since the random variables for are independent, it follows that
By Stirling’s formula, the number of subsets of Π of size satisfies
Thus for and n sufficiently large, estimates (6) and (7) imply
as required. □
4 More stringent bounds for the case ,
Let denote the smallest real number for which the conclusion of Theorem 2 holds in the class of cooperative Boolean networks. Theorem 2 states that , but gives no estimates of the magnitude of the difference. Some lower bounds for the differences were extracted from the proof of the theorem in Appendix C of preprint ; they appear to substantially underestimate the actual difference. For example, the proof of Theorem 2 shows only that . On the other hand, Corollary 19 of the preprint  gives an upper bound of , which is more stringent if α is sufficiently close to 1. In particular, since for no strictly quadratic, bi-quadratic Boolean network can be c-chaotic, this result implies together with Theorem 1(iii) that the latter estimate is optimal in this case and .
We will prove this result here only for the special case of cooperative systems, which makes the argument more transparent. The proof for the general case given in  uses essentially the same ideas.
Theorem 3 Consider a strictly quadratic, bi-quadratic, cooperative Boolean system of dimension n with a periodic orbit of size . Then .
Proof Let be as in the assumption, with . Call a subset closed if each for takes inputs only from I, and call I minimal closed if no proper subset of I is closed. Given the constraints on the indegree and outdegree of each node, it follows that all in- and outdegrees are equal to two, and that all outputs of elements from a minimal closed set I are also inside I. Therefore is the union of pairwise disjoint minimal closed sets , for , with for all ℓ. Let us call a vector of Boolean functions on a Boolean k-block if the corresponding Boolean system is strictly quadratic and bi-quadratic and is minimal closed in this system. Let us define for as the maximal size of the range of any Boolean k-block. Let , and let .
Returning to , we can see that and for any C in the range of g, in particular, for any C that is a periodic orbit of the system, we must have
Now the theorem is a consequence of the following lemma.
Lemma 4 for all integers .
Proof For we have , so let us assume . Consider a Boolean k-block . It is not hard to see that after a suitable renumbering of the input variables, we can assume wlog that takes inputs , for all and takes inputs , . For ease of notation, let us identify with 1. We call an o-node if and an a-node if . The proof of the lemma now splits into two cases.
Case 1: The sets of o-nodes and a-nodes are both nonempty
In this case we can group the variables in into one or more consecutive intervals of length in such a way that for each m, either will be an o-node while all nodes j with are a-nodes or will be an a-node while all nodes j with are o-nodes. Wlog assume the latter; the proof in the other case is symmetric. Then the restriction of a vector in the range of g to the variables in cannot have an isolated 1 in any of the positions , that is, if for some j with , then we must also have for some with .
Let be the number of Boolean vectors of length n that do not contain isolated 1s, except possibly in their first position. The related function that counts the number of Boolean vectors of length n that do not contain any isolated 1s whatsoever was studied in . Any vector that has exactly one isolated 1, in its first position, must start with the sequence 10, and it follows that for ,
It was reported in  that , where is the real root of , , and , are complex numbers with and . Thus
which together with (8) gives a crude upper bound
Since and , it follows that for all . Now we conclude that the range R of g satisfies
Case 2: The set of o-nodes is empty or the set of a-nodes is empty
Wlog assume that all nodes are o-nodes; the proof in the other case is symmetric. In this case, any vector in the range of g cannot have isolated 1s, except in the case where it takes the value 1 both on its first and last positions (so that these 1s are not isolated with respect to a circular topology on the indices). Let denote the number of such vectors of length n. A vector in our target set could have no isolated 1s whatsoever, could be obtained by adding a 1 at the beginning of a sequence that has at most one isolated 1, in its starting position, and then appending the sequence 01 at the end, or reversing such a vector. This double-counts the vectors in the target set that start with 10 and end with 01. Thus in view of (8) we obtain
By (9) this gives a crude upper bound
for . Since and , it follows that
holds for all . For the remaining , one can verify (10) by a direct calculation using the values reported in . We find that , , , , . Thus equality holds in (10) for ; for all other , the inequality is strict, and the lemma follows. □
5 p-Unstable strictly quadratic systems
In this section we derive even more stringent bounds on the maximal length of periodic orbits in quadratic systems that are α-biased (with sufficiently large α) than in the previous section, under the assumption that the system shows sufficiently large sensitivity to initial conditions. Let us first put this result into the context of previously constructed counterexamples.
For every positive integer n, there exists a 1-unstable, strictly quadratic, bi-quadratic cooperative Boolean system of dimension 2n (Proposition 21 of ). Moreover, for all positive constants and all sufficiently large n, there exist n-dimensional cooperative Boolean networks that are simultaneously bi-quadratic, c-chaotic, p-unstable (Theorem 4 of ) and even p-c-chaotic (Theorem 3.2 of ). As long as , the analogue of the latter result holds for strictly quadratic, bi-quadratic cooperative Boolean networks (Theorem 3.10 of ). By choosing and considering the limit as in the following theorem, we see that the upper bound on c in the latter counterexamples is optimal.
Theorem 4 Let , let c be a constant such that , and let . Then no α-biased quadratic Boolean system can simultaneously be c-chaotic and p-1-unstable.
Proof Let c be as in the assumption and assume is a c-chaotic strictly quadratic cooperative Boolean system of dimension n. A pair with will be called dominating if there are such that is the set of input variables for both and , and at least one of the functions , is biased. Let I be the set of all with outdegree 2 that act as an input of a dominating pair. □
Lemma 5 The set I has cardinality at most .
Proof Let J be the union of all dominating pairs for which at least one input variable is in I. Note that if , are dominating pairs of variables whose input variables contain variables with outdegree 2, then . Thus .
Let , and let i, be the corresponding indices of the inputs. Assume wlog that is biased and takes the value 1 on input vectors . Then takes the same value on at least two of the vectors x, y, z, and it follows that the range of has size at most 3. Since we assumed that there exists a periodic orbit of length at least , we must have , and the lemma follows by taking logarithms. □
Now let denote the set of variables with outdegree zero, denote the set of variables with outdegree 1 that act as an input to a biased regulatory function, and the set of variables outside of I with outdegree 2 that act as an input to two biased regulatory functions.
Consider a random initial state and the state obtained by flipping the value of the variable .
Clearly, if , then , since the variable is not used at all to calculate the next state.
If , then there is exactly one for which acts as an input. Since is assumed biased, it must take another input , and there exists a value such that the value of does not depend on the input as long as . The latter happens with probability 0.5; thus with probability ≥0.5, we will have .
Now consider the case when . Then there are such that acts as an input to both and , and , are both biased. Since by definition of , the other input variables , of , are distinct and different from . Since , are both biased, there exist such that neither the value of nor the value of depends on the input as long as and . The latter happens with probability 0.25; thus with probability ≥0.25, we will have .
Let us first assume for simplicity that is strictly quadratic and bi-quadratic. Since the sum of all indegrees is equal to the sum of all outdegrees, the sets and are empty in this case. The set of variables that act as an input to at least one unbiased regulatory function has size less than , thus we must have . Then, by Lemma 5,
Since with probability 0.25 a single-bit flip of a node in has no effect after one time step, inequality (11) implies that
and the theorem follows for this special case.
Now let us turn to the general case when is only assumed quadratic. For each k, let denote the set of variables with outdegree k. Then , but as defined above may be a proper subset of ; similarly for . Since the sum of all outdegrees must equal the sum of all indegrees and the system was assumed to be quadratic, we must have
We can deduce from (12) that
which in turn implies
As we mentioned above, . Moreover, since fewer than of all regulatory functions are unbiased, we have
Now it follows from (13) and (14) that
From the above and (15) we conclude that
and the theorem follows.
6 Generic behavior of cooperative networks
While our work so far has investigated the most extreme possible behavior (in terms of long periodic orbits), in this section we focus on the average behavior of cooperative Boolean networks. We first report some observations from simulation studies of cooperative Boolean networks that were randomly chosen from the class of all such networks with a specified maximum number r of inputs per node. Subsequently, we will formulate a conjecture on the expected behavior when the restriction on the number of inputs is removed and adduce some evidence for it.
In order to select a random Boolean network, it is important to understand how to select random cooperative regulatory functions with at most r inputs. Such functions are in bijective correspondence with antichains aka Sperner families of , that is, subsets of P such that no two elements are comparable under the partial order ≤. For a given antichain A, one can define the function
and one can verify that the assignment is a bijection. The number of antichains in the set is known as the Dedekind number , and the exact values are only known for . For , the Dedekind numbers are 6, 20, 168 and 7,581 respectively. For each of these choices of r, we computed a list of all antichains in the set and used the list to sample antichains uniformly. This sampling procedure is no longer feasible for , as the corresponding Dedekind number is already . We refrained from using ad hoc sampling methods for as they do not guarantee a uniform distribution, and the inherent biases might invalidate the results.
Given n, one antichain in was selected at random and independently for each variable. Moreover, the sets of inputs to each regulatory function were chosen randomly and independently in order to create a random Boolean network. The regulatory functions were defined as in (16), with and x representing the restriction of the input vector to the domain of after a suitable permutation of the variables. A random initial condition was selected, and the trajectory was calculated for all . This procedure was repeated for and , as well as , with 20 repetitions for each setting. The results of this simulation are displayed in Figure 1, using the norm at each time step.
Notice that for the norms of the trajectories tend to remain near . As r increases, the norms tend to converge towards 0 or n, indicating convergence of the trajectory towards or or to a small periodic orbit. The speed of convergence towards these steady states is similar for and , but when r is increased from 4 to 5, we observe slightly faster convergence of the norm.
In order to estimate the distribution of the number of periodic orbits, their length, and the size of their basins of attraction, for each of we sampled 100 networks. For each network we uniformly sampled 100 initial conditions, ran the system until it converged towards a periodic orbit, and measured the length of the orbit. We kept track of the number of trajectories that converged towards a given periodic orbit. We classified periodic orbits into four types as follows: the first type comprises the constant vectors and , which are always steady states in the system, i.e., periodic orbits of length 1; the second type comprises all other steady states; the third type comprises orbits of length 2 and 3; and the fourth type comprises all orbits of length larger than 3.
In Figure 2(a)-(b) we display an estimated histogram for the total number of observed periodic orbits that were reached in each of the sampled networks, for (a) and (b). Notice that this information is necessarily incomplete, since many periodic orbits may not have been found. Nevertheless, one can clearly see that for the average number of periodic orbits is significantly reduced. Figure 2(c) classifies networks by their indegree r and the type of a periodic orbit, and it displays the average number of periodic orbits across all sampled networks. Figure 2(d) complements this information by describing the average size of the basin of attraction of a given periodic orbit, measured as a percentage of the state space. We also measured the size distribution of the basins of attraction. We partitioned the interval into five equal intervals , and for each such interval, we counted how many periodic orbits of a given type have a basin of attraction with estimated size within that interval. The results for each value of r are displayed in Figure 2(e) through (h).
Notice that even though there might be several long periodic orbits in a given network, the basins of attraction of such periodic orbits tend to be very small. Periodic orbits of length >1 are reached from a significant fraction of initial conditions for , but for this fraction is already much smaller, and for it becomes negligible. Overall, we found that most trajectories for all r that we investigated converge towards a steady state. For , almost all of these are different from the constant vectors and , and for most trajectories converge towards these two vectors. The largest basins of attraction on average comprise about half of the state space; for instance, if the average steady state of type 1 attracts 47% of the trajectories. Since there are two such steady states, they combine to attract an average of 96% of all trajectories.
Close inspection of a subset of our simulations confirmed that the most complex behavior occurs for , with many trajectories reaching periodic orbits of the fourth type, that is, of length >3, that appear to have very small basins of attraction. On the other hand, some networks for appear to have a single steady state that attracts almost all initial conditions.
The above simulations indicate that for sufficiently large r, random cooperative networks tend to have highly ordered dynamics, and that the amount of chaos, at least in terms of the lengths of observed periodic orbits and the percentage of eventually frozen nodes, is very low. The latter is exactly the opposite of what is known for RBNs without the assumption of cooperativity, and it calls for a theoretical explanation.
For fixed r, consider the family of all antichains in with the uniform distribution. Furthermore, for , let denote the probability that for some , when A is randomly chosen from . By symmetry, depends only on r and , so we can extend it to a function defined on pairs of positive integers, with for . See Figure 3 for calculations of the value of for different values of r, k, displayed both in table form in panel (a) and in normalized form in panel (b).
While there exists a vast literature on antichains (see  for an encyclopedic review), the function appears not to have been explicitly investigated. The literature indicates that the vast majority of antichains tend to mostly contain elements of size very close to ; in particular, the proofs of asymptotic formulas for the number of antichains on that were derived in  and  point in this direction. Thus it appears that if grows a little slower than , we should have , and if grows a little faster than , we should have .
Let us call a function fast if and .
Conjecture 1 There exists a fast function κ such that .
This conjecture appears to be highly plausible , but may not immediately follow from known results. To see why it seems plausible, consider the related function that is defined like , but for antichains A that are randomly drawn from the family of all antichains on that consist of elements with identical norms. Then for the probability is bounded from above by the probability that a randomly chosen antichain in the restricted class consists of elements with norm ℓ for some . Note that for we have . This in turn implies that if for some , then
and the analogue of Conjecture 1 for with follows since grows much faster than . For we get the same order-of-magnitude estimates, and the analogous result follows from the additional observation that if A is a randomly chosen antichain that consists of elements with norm , then for a given x with , the probability that A contains an a with is equal to .
It may be possible to extract a proof of the conjecture by carefully analyzing the arguments in [25, 26], but this is not easy and would go beyond the scope of this paper.
Our next result shows that Conjecture 1 has a striking consequence for the dynamics of random cooperative networks without restrictions on the number of inputs r per variable. The explicit calculations and simulations that we were able to perform for small values of r (see Figures 3 and 2) add some credibility to this consequence of the conjecture.
Lemma 6 Assume that Conjecture 1 holds. Then the probability that the trajectory of a randomly chosen initial condition in a randomly chosen n-dimensional cooperative Boolean network reaches either the steady state vector or the steady state vector after one updating step approaches 1 as .
Proof For fixed n, choosing a random cooperative network can be conceptualized as the same procedure as we have been following in our simulations, but with . Thus for each we randomly and independently choose an antichain , and then we define the regulatory function , as in (16).
Now fix a probability , and let κ be as in Conjecture 1. Consider a randomly chosen initial condition . Then, for sufficiently large n, the probability that will be smaller than . Moreover, if , then the probability that , i.e., that at least one of the functions takes the value , can be assumed to be ; similarly, if , then the probability that , i.e., that at least one of the functions takes the value , can be assumed to be .
This implies that with probability ≥q, one of these two steady states will be reached after one updating step. □
Now consider what happens if we draw random cooperative networks and initial conditions as described at the beginning of this section for r moderately large but fixed. If , then the expected value of for the input vectors of the functions is . Thus if , we should see on average more input vectors with norm significantly larger than than input vectors with norm significantly smaller than and vice versa. Thus if decays sufficiently fast to 0 as increases, should be expected to have a larger absolute value and the same sign as , and the effect should amplify during subsequent iterations, until a steady state or a periodic orbit with all norms close to 0 or n is reached. This seems to be exactly what we observe in our simulations for .
Very long periodic orbits are a hallmark of chaotic dynamics in Boolean networks. It has long been known that such features as few inputs per node and prevalence of significantly biased regulatory functions reduce, on average, the propensity towards chaotic behavior in such networks, in particular, the prevalence of very long periodic orbits. However, nontrivial upper bounds on the lengths of periodic orbits had previously been proved only for some very restricted classes of Boolean networks.
The main result of this paper, Theorem 2, shows the existence of such bounds if both the number of inputs and the number of outputs per node are bounded by a constant and a fixed minimal fraction of all regulatory functions is assumed to be biased. Since there are only finitely many different Boolean functions on a given set of inputs, the assumptions of this theorem imply a lower bound on the amount of bias we see in each regulatory function. However, the analogue of the theorem fails if it is only assumed that a fixed fraction of regulatory functions shows a specified minimal amount of bias, even when the number of inputs (but not outputs) of each regulatory function is bounded. This follows from a previously published result that is reproduced as Theorem 1(ii) here.
If both the number of inputs and that of outputs are bounded by 2 and all regulatory functions are biased, then is an upper bound on the length of periodic orbits in n-dimensional networks. This result is proved in full generality in the preprint ; here we illustrated the main ideas of the proof by deriving the special case for cooperative networks (Theorem 3). By previously published results, the upper bound is optimal. It can be further improved for systems that show p-1-instability for sufficiently large (Theorem 4). For this gives an upper bound of on the length of periodic orbits in n-dimensional strictly quadratic cooperative Boolean networks. Again the latter bound is optimal by a result of , even for systems that have the stronger property of being p-unstable. Both p-instability and p-1-instability are formal counterparts of the general notion of sensitivity to initial conditions, which is considered to be another hallmark of chaotic dynamics. While sensitive dependence for Boolean systems can be formalized in a variety of ways (see ), p-1-instability for at least some is implied by all meaningful formal definitions.
Cooperativity is the absence of negative interactions, in particular, negative feedback loops. Previous empirical studies had already shown that reducing the amount of negative feedback tends to reduce, on average, the propensity towards chaotic dynamics in Boolean networks . Simulation studies reported in Section 6 above indicate that cooperative Boolean networks that are randomly drawn from the class of all such networks with at most r inputs per node tend to have trajectories that quickly converge to a steady state or a small periodic orbit. The effect becomes more pronounced as r increases. For , almost all sampled trajectories converged to steady states, and for , most of these were constant Boolean vectors. Thus the dynamics of random cooperative Boolean networks appears to become less chaotic, at least in terms of long periodic orbits and the proportion of eventually frozen nodes, as the number of inputs per node increases; exactly the opposite of what has been observed for RBNs without an assumption of cooperativity. We stated a conjecture about the distribution of sizes of sets in randomly chosen antichains that appears to conform with, but not immediately follow from, known results about these combinatorial objects. The conjecture implies that if a cooperative Boolean network and an initial condition are randomly chosen (without any restrictions on the number of inputs per node), the probability that a steady state is reached after only one step approaches 1 as the dimension of the network increases without bound.
These results open up several new avenues of further research. Since Theorem 2 assumes a fixed bound on the number of outputs, it does not directly apply to the study of RBNs from the class for which an upper bound r on the number of inputs is the only restriction. With probability approaching 1 as , the fraction of biased regulatory functions will be very close to the fraction of biased Boolean functions among all those with r inputs, so the vast majority of such networks will be α-biased for suitable α. However, the number of outputs per node will roughly follow a Poisson distribution with parameter , with only very few nodes having a (moderately) large number of outputs. The known counterexamples do not preclude a generalization of Theorem 2 to this weaker assumption on the distribution of outputs, and it becomes a natural question whether one can prove or disprove such a version of the theorem. Similarly, it might be of interest to find generalizations of Theorems 3 and 4 that deal with the case to corresponding networks with .
In Section 6 we defined a function that expresses the size distributions of sets in antichains aka Sperner families. As we argued at the end of that section, a characterization of the asymptotic behavior of the function should allow one to derive analytic bounds on the probability of trajectories in random cooperative Boolean networks with up to r inputs per node eventually reaching a steady state, and upper bounds on the expected lengths of the transients. In our opinion, the function deserves more systematic study by combinatorists. A characterization of the asymptotic behavior of this function would allow precise quantification of the well-known observation that for large r the overwhelming majority of Sperner families on contains predominantly vectors with close to coordinates equal to 0. Of particular interest from our point of view would be a proof of Conjecture 1, which hypothesizes specific bounds on asymptotic behavior of this function.
Chuang HY, Hofree M, Idekker T: A decade of systems biology. Annu. Rev. Cell Dev. Biol. 2010, 26: 721-744. 10.1146/annurev-cellbio-100109-104122
Tindall MJ, Porter SL, Maini PK, Gaglia G, Armitage JP: Overview of mathematical approaches used to model bacterial chemotaxis I: the single cell. Bull. Math. Biol. 2008, 70: 1525-1569. 10.1007/s11538-008-9321-6
Albert R, Othmer HG: The topology of the regulatory interactions predicts the expression pattern of the segment polarity genes in Drosophila melanogaster. J. Theor. Biol. 2003, 223: 1-18. 10.1016/S0022-5193(03)00035-3
Sontag ED: Monotone and near-monotone biochemical networks. Syst. Synth. Biol. 2007, 1: 59-87. 10.1007/s11693-007-9005-9
Smith HL Math Surveys and Monographs. In Monotone Dynamical Systems. Am. Math. Soc., Providence; 1995.
Just W, Malicki M: Cooperative Boolean systems with generically long attractors II. Adv. Differ. Equ. 2013., 2013: Article ID 268
Aldana M, Coppersmith S, Kadanoff LP: Boolean dynamics with random couplings. In Perspectives and Problems in Nonlinear Science. Edited by: Kaplan E, Marsden JE, Sreenivasan KR. Springer, Berlin; 2003:23-90.
Drossel B: Random Boolean networks. 1. In Reviews of Nonlinear Dynamics and Complexity. Edited by: Schuster HG. Wiley, New York; 2008:69-110.
Kauffman SA: Origins of Order: Self-Organization and Selection in Evolution. Oxford University Press, Oxford; 1993.
Kaufman V, Drossel B: On the properties of cycles of simple Boolean networks. Eur. Phys. J. B 2005, 43: 115-124. 10.1140/epjb/e2005-00034-6
Paul U, Kaufman V, Drossel B: Properties of attractors of canalyzing random Boolean networks. Phys. Rev. Lett. 2006., 73: Article ID 026118
Ho J-L: Global convergence for the XOR Boolean networks. Taiwan. J. Math. 2009, 13(4):1271-1282.
Ho J-L: A global convergence theorem in Boolean algebra. Taiwan. J. Math. 2010, 14(3B):1135-1144.
Jarrah AS, Laubenbacher R, Veliz-Cuba A: The dynamics of conjunctive and disjunctive Boolean network models. Bull. Math. Biol. 2010, 72: 1425-1447. 10.1007/s11538-010-9501-z
Arcena J, Demongeot J, Goles E: On limit cycles of monotone functions with symmetric connection graph. Theor. Comput. Sci. 2004, 322: 237-244. 10.1016/j.tcs.2004.03.010
Enciso GA, Just W: Analogues of the Smale and Hirsch theorems for cooperative Boolean and other discrete systems. J. Differ. Equ. Appl. 2012, 18: 223-238. 10.1080/10236190903357535
Just, W, Enciso, GA: Extremely Chaotic Boolean Networks. Preprint (2008). arXiv:0811.0115.
Just W, Enciso G: Exponentially long orbits in Boolean networks with exclusively positive interactions. Nonlinear Dyn. Syst. Theory 2011, 11: 275-284.
Just W, Malicki M: Cooperative Boolean systems with generically long attractors I. J. Differ. Equ. Appl. 2013, 19: 772-795. 10.1080/10236198.2012.691167
Hoeffding W: Probability inequalities for sums of bounded random variables. J. Am. Stat. Assoc. 1963, 58(301):13-30. 10.1080/01621459.1963.10500830
Austin RB, Guy RK: Binary sequences without isolated ones. Fibonacci Q. 1978, 16: 84-86.
McGarvey, G: Sequence A109377. The On-Line Encyclopedia of Integer Sequences, Sloane, NJA (ed.) (2008). Published electronically at http://oeis.org/A109377.
Schröder BS: Ordered Sets: An Introduction. Birkhäuser, Boston; 2003.
Engel K Encyclopedia of Mathematics and Its Applications 65. In Sperner Theory. Cambridge University Press, Cambridge; 1997.
Kleitman D, Markowsky G: On Dedekind’s problem: the number of isotone Boolean functions II. Trans. Am. Math. Soc. 1975, 213: 373-390.
Korshunov AD: The number of monotone Boolean functions. Probl. Kibern. 1981, 38: 5-108. (in Russian)
Engel, K: Private communication. October 29, 2012
Sontag ED, Veliz-Cuba A, Laubenbacher R, Jarrah AS: The effect of negative feedback loops on the dynamics of Boolean networks. Biophys. J. 2008, 95(2):518-526. 10.1529/biophysj.107.125021
We would like to thank the referees for insightful and valuable suggestions on how to improve the manuscript.
The authors declare that they have no competing interests.
The results of Sections 3-5 are mainly due to WJ; Section 6 is mainly due to GE. Both authors equally contributed to the editing of the entire material, read, and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Just, W., Enciso, G.A. Ordered dynamics in biased and cooperative Boolean networks. Adv Differ Equ 2013, 313 (2013). https://doi.org/10.1186/1687-1847-2013-313
- Boolean networks
- cooperative dynamical systems
- biased regulatory functions
- chaotic dynamics
- Sperner families