A hybrid optimization problem at characteristic times and its application in agroecological system

Abstract

In pest control, taking the lag of parasitic eggs, the lag effect of pesticide poisoning and the age of releasing natural enemies as control variables, combined with the crop fertility cycle, researches on the optimization problem of pest control models at seedling stage, the bud stage, and filling stage of crops fill in a gap. For these purposes, a generalized hybrid optimization problem involving state delay with characteristic times and parameter control is presented. Then an algorithm based on a gradient computation is given. Finally, two examples in an agroecological system are given to exhibit the effectiveness of the proposed optimization algorithm.

1 Introduction

A mathematical model for continuous control of insect pests is mostly used by a differential equation to describe the relationship between preys and predators. Apreutesei et al. [1] and Srinivasu et al. [2] investigated the optimal parameter selection problem of the pest control models. Apreutesei [3], Kard [4], Bhattacharyya [5, 6], and Molnar [7] took the external interference intensities of systems, such as the rate of pesticide poisoning, releasing rates of parasitic eggs, and infertility pests as well as pathogens, as control variables to study the optimal pest management strategy. In the above achievements, taking the differential equations as state equations, taking the Bolza type performance index as objective function, the authors sought the optimal control by utilizing Pontryagin’s minimum principle. These are standard optimal control problems [8].

In the last decade, research on the mathematical models of the chemical controls, biological controls, and of comprehensive control has made great progress. He et al. [9], Luo et al. [10] and Feng et al. [11] have investigated the optimal problems of microorganism and population dynamic systems. The National Natural Science Foundation of China has funded research projects related to the mathematical model for pest control. Despite all this, there are still some challenging problems worth exploring, including primarily: (1) lag, hibernate, delay phenomena of development from larva to adult and so on are widespread in the population life cycle, therefore considering optimal control problem of the ecological system with time delay is a meaningful work; (2) taking the lag of parasitic eggs, lag effect of pesticide poisoning and the age of releasing natural enemies as control variables (state delays), combined with the crop fertility cycle, research on the optimization problem of pest control models at seedling stage, bud stage and filling stage of crops fills (in) a gap which is optimal problem with multiple characteristic times.

The generalized model of these problems is a hybrid optimization problem involving state delay with characteristic time and parameter control. In this paper, we first present a general question on state delays, then design optimization algorithms. Finally, two examples in the field of pest control are given to exhibit the effectiveness of the proposed optimization algorithm.

2 Problem formulation

Consider the following nonlinear time delay system:

$$\begin{aligned}& \dot{\mathbf{y}}(t) = \mathbf{g} \bigl(\mathbf{y}(t),\mathbf{y}(t- \omega_{1}),\ldots, \mathbf{y}(t-\omega_{m}),\boldsymbol{ \omega}, \boldsymbol{\eta} \bigr),\quad t \in[0, t_{f}], \end{aligned}$$

(1)

$$\begin{aligned}& \mathbf{y}(t) = \boldsymbol{\psi}(t, \boldsymbol{\eta}),\quad t \leq0. \end{aligned}$$

(2)

Here $t_{f} > 0$ is a given terminal time, $\mathbf{y}(t) = (y_{1}(t), \ldots , y_{n}(t))^{T} \in R^{n}$ is the state vector, $\omega_{i}$, $i = 1,\ldots ,m$ are state delays and $\eta_{i}$, $i=1,2,\ldots,r$ are system parameters. $\mathbf{g}:R^{(m+1)n} \times R^{m} \times R^{r}\rightarrow R^{n}$ and $\boldsymbol{\psi} : R \times R^{r} \rightarrow R^{n}$ are given functions. Let

$$\boldsymbol{\omega} = (\omega_{1}, \ldots, \omega_{m} )^{T}\in R^{m},\quad\quad \boldsymbol{\eta} = ( \eta_{1}, \ldots, \eta_{r} )^{T}\in R^{r}. $$

Let $\mathcal{M}$ denote the set of all ω which are admissible state delay vectors. Let $\mathcal{F}$ denote the set of all η which are admissible parameter vectors.

The following bound constraints on the state delays and system parameters are imposed:

$$ A_{i} \leq\omega_{i} \leq B_{i},\quad i = 1, \ldots,m, $$

(3)

and

$$ C_{j} \leq\eta_{j} \leq D_{j},\quad j = 1, \ldots, r, $$

(4)

where $A_{i}$ and $B_{i}$, $C_{j}$, and $D_{j}$ are given constants such that $0 \leq A_{i} \leq B_{i}$ and $0 \leq C_{j} \leq D_{j}$.

Our aim is to seek admissible controls ω and η that minimize the following cost function:

$$\begin{aligned} J(\boldsymbol{\omega}, \boldsymbol{\eta}) = &\Theta \bigl(\mathbf{y}(t_{1} \mid\boldsymbol{\omega}, \boldsymbol{\eta}), \ldots, \mathbf{y}(t_{p} \mid\boldsymbol{\omega}, \boldsymbol{\eta}), \boldsymbol{\omega}, \boldsymbol{ \eta} \bigr) \\ &{}+ \int^{t_{f}} _{0}L \bigl(\mathbf{y}(t\mid\boldsymbol{ \omega}, \boldsymbol{\eta}),\mathbf {y}(t-\omega_{1}\mid\boldsymbol{ \omega}, \boldsymbol{\eta}),\ldots, \mathbf {y}(t-\omega_{m}\mid \boldsymbol{\omega}, \boldsymbol{\eta}), \boldsymbol{\omega}, \boldsymbol {\eta} \bigr)\,dt, \end{aligned}$$

(5)

where $\Theta: R^{pn} \times R^{m}\times R^{r} \rightarrow R$ is a given function and $t_{k}$, $k = 1, \ldots, p$ are given time points satisfying $0 < t_{1} < \cdots< t_{p} \leq t_{f}$. Time points $t_{k}$, $k = 1, \ldots, p$ are called characteristic times. We define the hybrid optimization problem with state delay as follows.

Problem (P)

Choose $(\boldsymbol{\omega}, \boldsymbol{\eta}) \in\mathcal {M} \times\mathcal{F}$ to minimize the cost function (5).

Remark

Both state equation (1) and cost function (5) are not only explicit but also implicit functions of the decision variables. In addition, our cost function (5) contains a integral term which is known as the problem of Lagrange. Hybridity of optimization problem increases the complexity of the calculation.

3 Algorithm design based on gradient computation

Define

$$\begin{aligned}& \boldsymbol{\phi}(t\mid\boldsymbol{\omega},\boldsymbol{\eta}) =\left \{ \textstyle\begin{array}{l@{\quad}l} \frac{\partial\boldsymbol{\psi}(t,\boldsymbol{\eta})}{\partial t},& \mbox{if } t< 0,\\ \mathbf{g}(\mathbf{y}(t\mid\boldsymbol{\omega}, \boldsymbol{\eta}),\mathbf{y}(t-\omega _{1}\mid\boldsymbol{\omega}, \boldsymbol{\eta}),\ldots, \mathbf{y}(t-\omega_{m}\mid\boldsymbol {\omega}, \boldsymbol{\eta}), \boldsymbol{\omega},\boldsymbol{\eta}),& \mbox{if } t\in[0,t_{f}], \end{array}\displaystyle \right . \\& \frac{\partial\bar{\mathbf{g}}(t\mid\boldsymbol{\omega},\boldsymbol{\eta })}{\partial\mathbf{y}} =\frac{\partial\mathbf{g}(\mathbf{y}(t\mid\boldsymbol{\omega}, \boldsymbol{\eta}), \mathbf {y}(t-\omega_{1}\mid\boldsymbol{\omega}, \boldsymbol{\eta}),\ldots, \mathbf {y}(t-\omega_{m}\mid\boldsymbol{\omega}, \boldsymbol{\eta}),\boldsymbol{\omega},\boldsymbol{\eta })}{\partial\mathbf{y}}, \\& \frac{\partial\bar{L}(t\mid\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\mathbf{y}} =\frac{\partial L(\mathbf{y}(t\mid\boldsymbol{\omega}, \boldsymbol{\eta}), \mathbf {y}(t-\omega_{1}\mid\boldsymbol{\omega}, \boldsymbol{\eta}),\ldots, \mathbf {y}(t-\omega_{m}\mid\boldsymbol{\omega}, \boldsymbol{\eta}),\boldsymbol{\omega},\boldsymbol{\eta })}{\partial\mathbf{y}}, \\& \frac{\partial\bar{\mathbf{g}}(t\mid\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\tilde{\mathbf{y}}^{i}} =\frac{\partial\mathbf{g}(\mathbf{y}(t\mid\boldsymbol{\omega}, \boldsymbol{\eta}), \mathbf{y}(t-\omega_{1}\mid\boldsymbol{\omega}, \boldsymbol{\eta}),\ldots, \mathbf{y}(t-\omega_{m}\mid\boldsymbol{\omega}, \boldsymbol{\eta}),\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\tilde{\mathbf{y}}^{i}}, \\& \frac{\partial\bar{L}(t\mid\boldsymbol{\omega},\boldsymbol{\eta})}{\partial \tilde{\mathbf{y}}^{i}} =\frac{\partial L(\mathbf{y}(t\mid\boldsymbol{\omega}, \boldsymbol{\eta}), \mathbf{y}(t-\omega_{1}\mid\boldsymbol{\omega}, \boldsymbol{\eta}),\ldots, \mathbf{y}(t-\omega_{m}\mid\boldsymbol{\omega}, \boldsymbol{\eta}),\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\tilde{\mathbf{y}}^{i}}, \end{aligned}$$

where $\frac{\partial}{\partial\tilde{\mathbf{y}}^{i}}$ is differentiation with respect to the ith delayed state vector.

Take into account the auxiliary impulsive system below,

$$\begin{aligned}& \dot{\boldsymbol{\lambda}}(t)=- \biggl\{ \biggl[ \frac{\partial \bar{L}(t\mid\boldsymbol{\omega},\boldsymbol{\eta})}{\partial \mathbf{y}(t)} \biggr]^{T} + \biggl[ \frac{\partial\bar{\mathbf{g}}(t\mid\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\mathbf{y}(t)} \biggr]^{T} \boldsymbol{\lambda}(t) \biggr\} \\& \hphantom{ \dot{\boldsymbol{\lambda}}(t)=}{}-\sum^{m}_{l=1} \biggl\{ \biggl[ \frac{\partial \bar{L}(t+\omega_{l}\mid\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\tilde{\mathbf{y}}^{l}} \biggr]^{T} + \biggl[ \frac{\partial\bar{\mathbf{g}}(t+\omega_{l}\mid\boldsymbol{\omega}, \boldsymbol {\eta})}{\partial\tilde{\mathbf{y}}^{l}} \biggr]^{T}\boldsymbol{\lambda}(t+\omega_{l}) \biggr\} , \\& \quad \mbox{for }t\in[0,t_{p}], \end{aligned}$$

(6)

$$\begin{aligned}& \boldsymbol{\lambda} \bigl(t^{-}_{k} \bigr)=\boldsymbol{ \lambda} \bigl(t^{+}_{k} \bigr) + \biggl[\frac{\partial\Theta(\mathbf{y}(t_{1}\mid\boldsymbol{\omega}, \boldsymbol{\eta}), \ldots, \mathbf{y}(t_{p}\mid\boldsymbol{\omega}, \boldsymbol{\eta}), \boldsymbol{\omega},\boldsymbol{\eta})}{\partial\mathbf{y}(t_{k})} \biggr]^{T}, \quad \mbox{for }k=1,\ldots,p, \end{aligned}$$

(7)

$$\begin{aligned}& \boldsymbol{\lambda}(t)=\boldsymbol{0}, \quad \mbox{for }t\geq t_{p}. \end{aligned}$$

(8)

Define $\boldsymbol{\lambda}(\cdot\mid\boldsymbol{\omega}, \boldsymbol{\eta})$ as the solution of system (6)-(8) matching the admissible control pair $(\boldsymbol{\omega}, \boldsymbol{\eta}) \in\mathcal{M}\times\mathcal{F}$.

In turn, the following result gives formulas for the partial derivatives of J with respect to the state delays.

Theorem 1

For each $(\boldsymbol{\omega}, \boldsymbol{\eta}) \in \mathcal{M }\times\mathcal{F}$, we obtain the following gradients with respect to time delays $\omega_{i}$:

$$\begin{aligned} \frac{\partial J(\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\omega_{i}} =& \frac{\partial\Theta}{\partial\omega_{i}} + \int^{t_{p}}_{0} \biggl\{ \frac{\partial\bar{L}(t)}{\partial\omega_{i}} + \boldsymbol{\lambda}^{T}(t)\frac{\partial\bar{\mathbf{g}}(t)}{\partial \omega_{i}} \\ &{}- \biggl(\frac{\partial\bar{ L}(t)}{\partial\tilde{\mathbf{y}}^{i}} +\boldsymbol{\lambda}^{T}(t) \frac{\partial\bar{\mathbf{g}}(t)}{\partial \tilde{\mathbf{y}}^{i}} \biggr) \boldsymbol{\phi}(t- \omega_{i}\mid \boldsymbol{\omega},\boldsymbol{\eta}) \biggr\} \,dt, \end{aligned}$$

(9)

where $i=1,\ldots,m$.

Proof

Let the function $\boldsymbol{\varrho}(t) : [0,\infty) \rightarrow R^{n}$. Assume that $\boldsymbol{\varrho}(t)$ is continuous and differentiable on the intervals $(t_{k-1}, t_{k})$, $k = 1, \ldots, p + 1$, where $t_{0} = 0$, $t_{p+1} = \infty$. Furthermore $\lim_{t\rightarrow t^{+}_{0}}\boldsymbol{\varrho}(t)$ exists and for each $t=t_{k}$ ($k = 1, \ldots, p$), $\lim_{t\rightarrow t^{\pm}_{k}}\boldsymbol{\varrho}(t)$ exists. We may express the cost function J as follows:

$$ \begin{aligned} J(\boldsymbol{\omega},\boldsymbol{\eta})&=\Theta \bigl( \mathbf{y}(t_{1}), \ldots, \mathbf{y}(t_{p}), \boldsymbol{\omega}, \boldsymbol{\eta} \bigr) + \int^{t_{p}}_{0} \bigl\{ L(t\mid\boldsymbol{\omega}, \boldsymbol{\eta}) + \boldsymbol{\varrho}^{T}(t)\mathbf{g}(t\mid \boldsymbol{\omega},\boldsymbol{\eta})-\boldsymbol{\varrho}^{T}(t)\dot{ \mathbf{y}}(t) \bigr\} \,dt \\ &=\Theta \bigl(\mathbf{y}(t_{1}), \ldots, \mathbf{y}(t_{p}), \boldsymbol{\omega},\boldsymbol{\eta} \bigr) +\sum^{p}_{k=1} \int^{t_{k}}_{t_{k-1}} \bigl\{ L(t\mid\boldsymbol{\omega}, \boldsymbol{\eta})+ \boldsymbol{\varrho}^{T}(t)\mathbf{g}(t\mid \boldsymbol{\omega},\boldsymbol{\eta}) \bigr\} \,dt \\ &\quad{} - \sum^{p}_{k=1} \int^{t_{k}}_{t_{k-1}}\boldsymbol{\varrho}^{T}(t) \dot{ \mathbf{y}}(t)\,dt. \end{aligned} $$

Applying integration by parts to the last integral gives

$$\begin{aligned} J(\boldsymbol{\omega},\boldsymbol{\eta}) =&\Theta \bigl(\mathbf{y}(t_{1}), \ldots, \mathbf{y}(t_{p}),\boldsymbol{\omega}, \boldsymbol{\eta} \bigr)+\sum^{p}_{k=1} \int^{t_{k}}_{t_{k-1}} \bigl\{ L(t\mid\boldsymbol{\omega}, \boldsymbol{\eta})+\boldsymbol{\varrho}^{T}(t)\mathbf{g}(t\mid \boldsymbol{\omega},\boldsymbol{\eta}) \bigr\} \,dt \\ &{}-\sum^{p}_{k=1} \bigl\{ \boldsymbol{ \varrho}^{T} \bigl(t_{k}^{-} \bigr) \mathbf{y}(t_{k})-\boldsymbol{\varrho}^{T} \bigl(t_{k-1}^{+} \bigr)\mathbf{y}(t_{k-1}) \bigr\} + \sum^{p}_{k=1} \int^{t_{k}}_{t_{k-1}}\dot{\boldsymbol{\varrho}}^{T}(t) \mathbf{y}(t)\,dt. \end{aligned}$$

(10)

Computing the above third term shows

$$\begin{aligned}& \sum^{p}_{k=1} \bigl\{ \boldsymbol{ \varrho}^{T} \bigl(t_{k}^{-} \bigr) \mathbf{y}(t_{k})-\boldsymbol{\varrho}^{T} \bigl(t_{k-1}^{+} \bigr)\mathbf{y}(t_{k-1}) \bigr\} \\& \quad = \sum^{p}_{k=1} \boldsymbol{ \varrho}^{T} \bigl(t_{k}^{-} \bigr) \mathbf{y}(t_{k})-\sum^{p}_{k=1} \boldsymbol{\varrho}^{T} \bigl(t_{k-1}^{+} \bigr) \mathbf{y}(t_{k-1}) \\& \quad = \sum^{p}_{k=1}\boldsymbol{ \varrho}^{T} \bigl(t_{k}^{-} \bigr) \mathbf{y}(t_{k})-\sum^{p-1}_{k=0} \boldsymbol{\varrho}^{T} \bigl(t_{k}^{+} \bigr) \mathbf{y}(t_{k}) \\& \quad = \boldsymbol{\varrho}^{T} \bigl(t_{p}^{-} \bigr) \mathbf{y}(t_{p})+\sum^{p-1}_{k=1} \bigl\{ \boldsymbol{\varrho}^{T} \bigl(t_{k}^{-} \bigr)- \boldsymbol{\varrho}^{T} \bigl(t_{k}^{+} \bigr) \bigr\} \mathbf{y}(t_{k})-\boldsymbol{\varrho}^{T} \bigl(t_{0}^{+} \bigr)\mathbf{y}(t_{0}). \end{aligned}$$

(11)

Substituting (11) into (10) yields

$$\begin{aligned} J(\boldsymbol{\omega},\boldsymbol{\eta}) =&\Theta \bigl(\mathbf{y}(t_{1}), \ldots, \mathbf{y}(t_{p}),\boldsymbol{\omega}, \boldsymbol{\eta} \bigr)+\sum^{p}_{k=1} \int^{t_{k}}_{t_{k-1}} \bigl\{ L(t\mid\boldsymbol{\omega}, \boldsymbol{\eta})+ \boldsymbol{\varrho}^{T}(t)\mathbf{g}(t\mid \boldsymbol{\omega},\boldsymbol{\eta}) \bigr\} \,dt \\ &{}+\sum^{p}_{k=1} \int^{t_{k}}_{t_{k-1}}\dot{\boldsymbol{\varrho}}^{T}(t) \mathbf{y}(t)\,dt-\boldsymbol{\varrho}^{T} \bigl(t_{p}^{-} \bigr) \mathbf{y}(t_{p}) \\ &{}-\sum^{p-1}_{k=1} \bigl\{ \boldsymbol{ \varrho}^{T} \bigl(t_{k}^{-} \bigr)-\boldsymbol{ \varrho}^{T} \bigl(t_{k}^{+} \bigr) \bigr\} \mathbf{y}(t_{k})+\boldsymbol{\varrho}^{T} \bigl(0^{+} \bigr) \boldsymbol{\psi}(0,\boldsymbol{\eta}). \end{aligned}$$

(12)

Let $\delta_{li}$ be the Kronecker delta function and define

$$\boldsymbol{\Delta}^{i}(t) =\frac{\partial\mathbf{y}(t)}{\partial\omega _{i}},\quad t \in(-\infty, t_{f} ]. $$

Then

$$ \frac{\partial}{\partial\omega_{i}} \bigl\{ \mathbf{y}(t-\omega_{l}) \bigr\} =\left \{ \textstyle\begin{array}{l@{\quad}l} -\delta_{li}\frac{\partial\boldsymbol{\psi}(t-\omega_{l}, \boldsymbol{\eta})}{\partial t},& t < \omega_{l},\\ \boldsymbol{\Delta}^{i}(t-\omega_{l})-\delta_{li}\dot{\mathbf{y}}(t-\omega _{l}),& t \geq\omega_{l} . \end{array}\displaystyle \right . $$

(13)

Define the indicator function:

$$\chi_{[\omega_{l},\infty)}(t) =\left \{ \textstyle\begin{array}{l@{\quad}l} 1,& \mbox{if } t \geq\omega_{l},\\ 0,& \mbox{otherwise}. \end{array}\displaystyle \right . $$

Equation (13) is rewritten

$$ \frac{\partial}{\partial\omega_{i}} \bigl\{ \mathbf{y}(t-\omega_{l}) \bigr\} = \boldsymbol{\Delta}^{i}(t-\omega_{l})\chi_{[\omega_{l},\infty)}(t)- \delta _{li}\boldsymbol{\phi}(t-\omega_{l}). $$

(14)

Next, according to (14), differentiating (12) with respect to $\omega _{i}$ one obtains

$$ \begin{aligned} \frac{\partial J(\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\omega_{i}} &=\frac{\partial\Theta(\mathbf{y}(t_{1}),\ldots,\mathbf{y}(t_{p}),\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\omega_{i}} +\sum ^{p}_{k=1}\frac{\partial\Theta(\mathbf{y}(t_{1}),\ldots, \mathbf{y}(t_{p}),\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\mathbf{y}(t_{k})}\boldsymbol{ \Delta}^{i}(t_{k}) \\ &\quad{} + \int^{t_{p}}_{0} \biggl\{ \frac{\partial\bar{L}}{\partial\omega_{i}} + \boldsymbol{\varrho}^{T}(t)\frac{\partial\bar{\mathbf{g}}}{\partial\omega _{i}} \biggr\} \,dt +\sum ^{p}_{k=1} \int^{t_{k}}_{t_{k-1}} \biggl\{ \frac{\partial\bar {L}(t)}{\partial\mathbf{y}} + \boldsymbol{\varrho}^{T}(t)\frac{\partial\bar{\mathbf{g}}(t)}{\partial \mathbf{y}} \biggr\} \boldsymbol{ \Delta}^{i}(t)\,dt \\ &\quad{}+\sum^{m}_{l=1}\sum ^{p}_{k=1} \int^{t_{k}}_{t_{k-1}} \biggl\{ \frac {\partial\bar{L}(t)}{\partial\tilde{\mathbf{y}}^{l}} + \boldsymbol{\varrho}^{T}(t)\frac{\partial\bar{\mathbf{g}}(t)}{\partial \tilde{\mathbf{y}}^{l}} \biggr\} \boldsymbol{ \Delta}^{i}(t- \omega_{l})\chi _{[\omega_{l},\infty)}(t)\,dt \\ &\quad{}-\sum^{p}_{k=1} \int^{t_{k}}_{t_{k-1}} \biggl\{ \frac{\partial\bar {L}(t)}{\partial\tilde{\mathbf{y}}^{i}} + \boldsymbol{\varrho}^{T}(t) \frac{\partial\bar{\mathbf{g}}(t)}{\partial\tilde{\mathbf{y}}^{i}} \biggr\} \boldsymbol{ \phi}(t- \omega_{i})\,dt-\boldsymbol{\varrho}^{T} \bigl(t_{p}^{-} \bigr)\boldsymbol{\Delta}^{i}(t_{p}) \\ &\quad{}-\sum^{p-1}_{k=1} \bigl\{ \boldsymbol{\varrho}^{T} \bigl(t_{k}^{-} \bigr)- \boldsymbol{\varrho}^{T} \bigl(t_{k}^{+} \bigr) \bigr\} \boldsymbol{\Delta}^{i}(t_{k})+\sum ^{p}_{k=1} \int ^{t_{k}}_{t_{k-1}}\dot{\boldsymbol{\varrho}}^{T}(t) \boldsymbol{\Delta}^{i}(t)\,dt. \end{aligned} $$

Therefore

$$\begin{aligned} \frac{\partial J(\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\omega_{i}} =&\frac{\partial\Theta}{\partial\omega_{i}} + \int^{t_{p}}_{0} \biggl\{ \frac{\partial\bar{L}}{\partial\omega_{i}} + \boldsymbol{\varrho}^{T}(t)\frac{\partial\bar{\mathbf{g}}}{\partial\omega _{i}} \biggr\} \,dt \\ &{}+\sum^{p-1}_{k=1} \biggl\{ \frac{\partial\Theta(\mathbf{y}(t_{1}),\ldots ,\mathbf{y}(t_{p}),\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\mathbf{y}(t_{k})} -\boldsymbol{\varrho}^{T} \bigl(t_{k}^{-} \bigr)+\boldsymbol{\varrho}^{T} \bigl(t_{k}^{+} \bigr) \biggr\} \boldsymbol{\Delta}^{i}(t_{k})-\boldsymbol{ \varrho}^{T} \bigl(t_{p}^{-} \bigr)\boldsymbol{ \Delta}^{i}(t_{p}) \\ &{}+\frac{\partial\Theta(\mathbf{y}(t_{1}),\ldots,\mathbf{y}(t_{p}),\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\mathbf{y}(t_{p})}\boldsymbol{\Delta}^{i}(t_{p}) \\ &{} + \int^{t_{p}}_{0} \biggl\{ \dot{\boldsymbol{ \varrho}}^{T}(t)+ \frac{\partial \bar{L}(t)}{\partial\mathbf{y}} +\boldsymbol{\varrho}^{T}(t) \frac{\partial\bar{\mathbf{g}}(t)}{\partial\mathbf{y}} \biggr\} \boldsymbol{\Delta}^{i}(t)\,dt \\ &{}+\sum^{m}_{l=1} \int^{t_{p}}_{0} \biggl\{ \frac{\partial\bar {L}(t)}{\partial\tilde{\mathbf{y}}^{l}} + \boldsymbol{\varrho}^{T}(t) \frac{\partial\bar{\mathbf{g}}(t)}{\partial\tilde{\mathbf{y}}^{l}} \biggr\} \boldsymbol{ \Delta}^{i}(t- \omega_{l})\chi_{[\omega_{l},\infty)}(t)\,dt \\ &{}- \int^{t_{p}}_{0} \biggl\{ \frac{\partial\bar{L}(t)}{\partial\tilde {\mathbf{y}}^{i}} + \boldsymbol{\varrho}^{T}(t) \frac{\partial\bar{\mathbf{g}}(t)}{\partial\tilde{\mathbf{y}}^{i}} \biggr\} \boldsymbol{ \phi}(t- \omega_{i})\,dt. \end{aligned}$$

(15)

Again the second last integral term in (15) can be transformed as

$$ \begin{aligned}[b] & \int^{t_{p}}_{0} \biggl\{ \frac{\partial\bar{L}(t)}{\partial\tilde {\mathbf{y}}^{l}} + \boldsymbol{\varrho}^{T}(t) \frac{\partial\bar{\mathbf{g}}(t)}{\partial\tilde{\mathbf{y}}^{l}} \biggr\} \boldsymbol{ \Delta}^{i}(t- \omega_{l})\chi_{[\omega_{l},\infty)}(t)\,dt \\ &\quad = \int^{t_{p}-\omega_{l}}_{-\omega_{l}} \biggl\{ \frac{\partial\bar {L}(t+\omega_{l})}{\partial\tilde{\mathbf{y}}^{l}} + \boldsymbol{\varrho}^{T}(t+\omega_{l}) \frac{\partial\bar{\mathbf{g}}(t+\omega_{l})}{\partial\tilde{ \mathbf{y}}^{l}} \biggr\} \boldsymbol{\Delta}^{i}(t)\chi_{[0,\infty)}(t)\,dt \\ &\quad = \int^{t_{p}-\omega_{l}}_{0} \biggl\{ \frac{\partial\bar{L}(t+\omega _{l})}{\partial\tilde{\mathbf{y}}^{l}} + \boldsymbol{\varrho}^{T}(t+\omega_{l}) \frac{\partial\bar{\mathbf{g}}(t+\omega_{l})}{\partial\tilde{ \mathbf{y}}^{l}} \biggr\} \boldsymbol{\Delta}^{i}(t)\chi_{[0,\infty)}(t)\,dt. \end{aligned} $$

(16)

So, by (15) and (16),

$$ \begin{aligned}[b] \frac{\partial J(\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\omega_{i}} &=\frac{\partial\Theta}{\partial\omega_{i}} + \int^{t_{p}}_{0} \biggl\{ \frac{\partial\bar{L}}{\partial\omega_{i}} + \boldsymbol{\varrho}^{T}(t)\frac{\partial\bar{\mathbf{g}}}{\partial\omega _{i}} \biggr\} \,dt \\ &\quad {}\times\sum^{p-1}_{k=1} \biggl\{ \frac{\partial\Theta(\mathbf{y}(t_{1}),\ldots ,\mathbf{y}(t_{p}),\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\mathbf{y}(t_{k})} -\boldsymbol{\varrho}^{T} \bigl(t_{k}^{-} \bigr)+\boldsymbol{\varrho}^{T} \bigl(t_{k}^{+} \bigr) \biggr\} \boldsymbol{\Delta}^{i}(t_{k}) \\ &\quad {}+ \biggl\{ \frac{\partial\Theta(\mathbf{y}(t_{1}),\ldots,\mathbf{y}(t_{p}),\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\mathbf{y}(t_{p})}-\boldsymbol{\varrho}^{T} \bigl(t_{p}^{-} \bigr) \biggr\} \boldsymbol{ \Delta}^{i}(t_{p}) \\ &\quad {}+ \int^{t_{p}}_{0}\dot{\boldsymbol{\varrho}}^{T}(t) \boldsymbol{\Delta}^{i}(t)\,dt + \int^{t_{p}}_{0} \biggl\{ \frac{\partial\bar{L}(t)}{\partial\mathbf{y}} + \boldsymbol{\varrho}^{T}(t)\frac{\partial\bar{\mathbf{g}}(t)}{\partial \mathbf{y}} \biggr\} \boldsymbol{ \Delta}^{i}(t)\,dt \\ &\quad {}+\sum^{m}_{l=1} \int^{t_{p}-\omega_{l}}_{0} \biggl\{ \frac{\partial\bar {L}(t+\omega_{l})}{\partial\tilde{\mathbf{y}}^{l}} + \boldsymbol{\varrho}^{T}(t+\omega_{l}) \frac{\partial\bar{\mathbf{g}}(t+\omega_{l})}{\partial\tilde{ \mathbf{y}}^{l}} \biggr\} \boldsymbol{\Delta}^{i}(t)\chi_{[0,\infty)}(t)\,dt \\ &\quad {}- \int^{t_{p}}_{0} \biggl\{ \frac{\partial\bar{L}(t)}{\partial\tilde {\mathbf{y}}^{i}} + \boldsymbol{\varrho}^{T}(t) \frac{\partial\bar{\mathbf{g}}(t)}{\partial\tilde{\mathbf{y}}^{i}} \biggr\} \boldsymbol{ \phi}(t- \omega_{i})\,dt. \end{aligned} $$

(17)

Because the function $\boldsymbol{\lambda}(\cdot\mid\boldsymbol{\omega},\boldsymbol{\eta})$ meets all properties of ϱ and its arbitrariness, one may choose $\boldsymbol{\varrho}= \boldsymbol{\lambda}(\cdot\mid\boldsymbol{\omega},\boldsymbol{\eta})$ in (17). Then together with (7) and (8), we get

$$ \begin{aligned} \frac{\partial J(\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\omega_{i}} &=\frac{\partial\Theta}{\partial\omega_{i}} + \int^{t_{p}}_{0} \biggl\{ \frac{\partial\bar{L}}{\partial\omega_{i}} + \boldsymbol{\lambda}^{T}(t)\frac{\partial\bar{\mathbf{g}}}{\partial\omega _{i}} \biggr\} \,dt \\ &\quad {}+ \int^{t_{p}}_{0}\dot{\boldsymbol{\lambda}}^{T}(t) \boldsymbol{\Delta}^{i}(t)\,dt+ \int^{t_{p}}_{0} \biggl\{ \frac{\partial\bar{L}(t)}{\partial \mathbf{y}} + \boldsymbol{\lambda}^{T}(t)\frac{\partial\bar{\mathbf{g}}(t)}{\partial \mathbf{y}} \biggr\} \boldsymbol{ \Delta}^{i}(t)\,dt \\ &\quad {}+\sum^{m}_{l=1} \int^{t_{p}}_{0} \biggl\{ \frac{\partial\bar {L}(t+\omega_{l})}{\partial\tilde{\mathbf{y}}^{l}} + \boldsymbol{\lambda}^{T}(t+\omega_{l}) \frac{\partial\bar{\mathbf{g}}(t+\omega_{l})}{\partial\tilde{ \mathbf{y}}^{l}} \biggr\} \boldsymbol{\Delta}^{i}(t)\,dt \\ &\quad {}- \int^{t_{p}}_{0} \biggl\{ \frac{\partial\bar{L}(t)}{\partial\tilde {\mathbf{y}}^{i}} + \boldsymbol{\lambda}^{T}(t) \frac{\partial\bar{\mathbf{g}}(t)}{\partial\tilde{\mathbf{y}}^{i}} \biggr\} \boldsymbol{ \phi}(t- \omega_{i})\,dt. \end{aligned} $$

So, combined with (6), one obtains

$$\frac{\partial J(\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\omega_{i}} =\frac{\partial\Theta}{\partial\omega_{i}} + \int^{t_{p}}_{0} \biggl\{ \frac{\partial\bar{L}}{\partial\omega_{i}} + \boldsymbol{\lambda}^{T}(t)\frac{\partial\bar{\mathbf{g}}}{\partial\omega_{i}} - \biggl( \frac{\partial\bar{ L}(t)}{\partial\tilde{\mathbf{y}}^{i}} +\boldsymbol{\lambda}^{T}(t)\frac{\partial\bar{\mathbf{g}}(t)}{\partial \tilde{\mathbf{y}}^{i}} \biggr) \boldsymbol{\phi}(t- \omega_{i}) \biggr\} \,dt. $$

The proof is completed. □

Next we calculate the gradients of J with respect to the system parameters.

Theorem 2

For each $(\boldsymbol{\omega}, \boldsymbol{\eta}) \in \mathcal{M }\times\mathcal{F}$, we obtain the following gradients with respect to the system parameters $\eta_{j}$:

$$ \begin{aligned}[b] \frac{\partial J(\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\eta_{j}} &=\frac{\partial\Theta(\mathbf{y}(t_{1}\mid\boldsymbol{\omega},\boldsymbol{\eta}),\ldots,\mathbf{y}(t_{p}\mid\boldsymbol{\omega},\boldsymbol{\eta}),\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\eta_{j}} + \boldsymbol{\lambda}^{T} \bigl(0^{+}\mid\boldsymbol{\omega}, \boldsymbol{\eta} \bigr) \frac{\partial \boldsymbol{\psi}(0,\boldsymbol{\eta})}{\partial\eta_{j}} \\ &\quad{} + \int^{t_{p}}_{0} \biggl\{ \frac{\partial\bar{L}(t\mid\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\eta_{j}} + \boldsymbol{\lambda}^{T}(t\mid\boldsymbol{\omega},\boldsymbol{\eta}) \frac{\partial\bar{\mathbf{g}}(t\mid\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\eta_{j}} \biggr\} \,dt \\ &\quad{}+\sum^{m}_{l=1} \int^{0}_{-\omega_{l}} \biggl\{ \frac{\partial\bar {L}(t+\omega_{l}\mid\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\tilde{\mathbf{y}}^{l}} + \boldsymbol{\lambda}^{T}(t+\omega_{l}\mid\boldsymbol{\omega}, \boldsymbol{\eta}) \frac {\partial\bar{\mathbf{g}}(t+\omega_{l}\mid\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\tilde{\mathbf{y}}^{l}} \biggr\} \\ &\quad{}\times\frac{\partial\boldsymbol{\psi}(t,\boldsymbol{\eta})}{\partial\eta_{j}}\,dt, \end{aligned} $$

(18)

where $j = 1,\ldots, r$.

Proof

Recall $\boldsymbol{\varrho}(\cdot)$ and equation (12) in the proof of Theorem 1. Differentiating (12) with respect to $\eta_{j}$ gives

$$\begin{aligned}& \frac{\partial J(\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\eta_{j}} \\& \quad = \frac{\partial\Theta(\mathbf{y}(t_{1}),\ldots, \mathbf{y}(t_{p}),\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\eta_{j}} +\sum^{p}_{k=1} \frac{\partial\Theta(\mathbf{y}(t_{1}),\ldots, \mathbf{y}(t_{p}),\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\mathbf{y}(t_{k})} \frac {\partial\mathbf{y}(t_{k})}{\partial\eta_{j}} \\& \quad\quad{} +\sum^{p}_{k=1} \int^{t_{k}}_{t_{k-1}} \biggl\{ \frac{\partial\bar {L}(t)}{\partial\mathbf{y}} + \boldsymbol{\varrho}^{T}(t)\frac{\partial\bar{\mathbf{g}}(t)}{\partial \mathbf{y}} \biggr\} \frac{\partial\mathbf{y}(t)}{\partial\eta_{j}} \,dt +\sum^{p}_{k=1} \int^{t_{k}}_{t_{k-1}} \biggl\{ \frac{\partial\bar {L}(t)}{\partial\eta_{j}} + \boldsymbol{\varrho}^{T}(t)\frac{\partial\bar{\mathbf{g}}(t)}{\partial\eta _{j}} \biggr\} \,dt \\& \quad\quad{} +\sum^{m}_{l=1}\sum ^{p}_{k=1} \int^{t_{k}}_{t_{k-1}} \biggl\{ \frac {\partial\bar{L}(t)}{\partial\tilde{\mathbf{y}}^{l}} + \boldsymbol{\varrho}^{T}(t) \frac{\partial\bar{\mathbf{g}}(t)}{\partial\tilde{\mathbf{y}}^{l}} \biggr\} \frac{\partial\mathbf{y}(t-\omega_{l})}{\partial\eta_{j}}\,dt -\boldsymbol{\varrho}^{T} \bigl(t_{p}^{-} \bigr) \frac{\partial\mathbf{y}(t_{p})}{\partial \eta_{j}} \\& \quad\quad{} -\sum^{p-1}_{k=1} \bigl\{ \boldsymbol{\varrho}^{T} \bigl(t_{k}^{-} \bigr)- \boldsymbol{\varrho}^{T} \bigl(t_{k}^{+} \bigr) \bigr\} \frac{\partial\mathbf{y}(t_{k})}{\partial\eta_{j}} +\boldsymbol{\varrho}^{T} \bigl(0^{+} \bigr) \frac{\partial\boldsymbol{\psi}(0,\boldsymbol{\eta})}{\partial\eta_{j}} +\sum ^{p}_{k=1} \int^{t_{k}}_{t_{k-1}}\dot{\boldsymbol{\varrho}}^{T}(t) \frac {\partial\mathbf{y}(t)}{\partial\eta_{j}}\,dt. \end{aligned}$$

Hence

$$\begin{aligned} \frac{\partial J(\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\eta_{j}} =&\frac{\partial\Theta(\mathbf{y}(t_{1}),\ldots,\mathbf{y}(t_{p}), \boldsymbol{\omega},\boldsymbol{\eta})}{\partial\eta_{j}} + \biggl\{ \frac{\partial\Theta(\mathbf{y}(t_{1}),\ldots,\mathbf{y}(t_{p}),\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\mathbf{y}(t_{p})} - \boldsymbol{\varrho}^{T} \bigl(t_{p}^{-} \bigr) \biggr\} \frac{\partial \mathbf{y}(t_{p})}{\partial\eta_{j}} \\ &{} +\sum^{p-1}_{k=1} \biggl\{ \frac{\partial\Theta(\mathbf{y}(t_{1}),\ldots ,\mathbf{y}(t_{p}),\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\mathbf{y}(t_{k})} -\boldsymbol{\varrho}^{T} \bigl(t_{k}^{-} \bigr)+\boldsymbol{\varrho}^{T} \bigl(t_{k}^{+} \bigr) \biggr\} \frac{\partial\mathbf{y}(t_{k})}{\partial\eta_{j}} \\ &{}+ \int^{t_{p}}_{0} \biggl\{ \dot{\boldsymbol{ \varrho}}^{T}(t)+ \frac{\partial \bar{L}(t)}{\partial\mathbf{y}} +\boldsymbol{\varrho}^{T}(t) \frac{\partial\bar{\mathbf{g}}(t)}{\partial\mathbf{y}} \biggr\} \frac{\partial\mathbf{y}(t)}{\partial\eta_{j}}\,dt \\ &{}+\sum^{m}_{l=1} \int^{t_{p}}_{0} \biggl\{ \frac{\partial\bar {L}(t)}{\partial\tilde{\mathbf{y}}^{l}} + \boldsymbol{\varrho}^{T}(t) \frac{\partial\bar{\mathbf{g}}(t)}{\partial\tilde{\mathbf{y}}^{l}} \biggr\} \frac{\partial\mathbf{y}(t-\omega_{l})}{\partial\eta_{j}}\,dt \\ &{}+ \int^{t_{p}}_{0} \biggl\{ \frac{\partial\bar{L}(t)}{\partial\eta_{j}} + \boldsymbol{\varrho}^{T}(t)\frac{\partial\bar{\mathbf{g}}(t)}{\partial\eta _{j}} \biggr\} \,dt +\boldsymbol{ \varrho}^{T} \bigl(0^{+} \bigr)\frac{\partial\boldsymbol{\psi}(0,\boldsymbol{\eta})}{\partial\eta_{j}}. \end{aligned}$$

(19)

For $t \leq0$, $\mathbf{y}(t) = \boldsymbol{\psi}(t,\boldsymbol{\eta})$, then we have

$$\begin{aligned}& \int^{t_{p}}_{0} \biggl\{ \frac{\partial\bar{L}(t)}{\partial\tilde {\mathbf{y}}^{l}} + \boldsymbol{\varrho}^{T}(t) \frac{\partial\bar{\mathbf{g}}(t)}{\partial\tilde{\mathbf{y}}^{l}} \biggr\} \frac{\partial\mathbf{y}(t-\omega_{l})}{\partial\eta_{j}}\,dt \\& \quad = \int^{0}_{-\omega_{l}} \biggl\{ \frac{\partial\bar{L}(t+\omega _{l})}{\partial\tilde{\mathbf{y}}^{l}} + \boldsymbol{\varrho}^{T}(t+\omega_{l}) \frac{\partial\bar{\mathbf{g}}(t+\omega_{l})}{\partial\tilde{ \mathbf{y}}^{l}} \biggr\} \frac{\partial\boldsymbol{\psi}(t,\boldsymbol{\eta})}{\partial \eta_{j}}\,dt \\& \quad\quad{} + \int^{t_{p}-\omega_{l}}_{0} \biggl\{ \frac{\partial\bar{L}(t+\omega _{l})}{\partial\tilde{\mathbf{y}}^{l}} + \boldsymbol{\varrho}^{T}(t+\omega_{l}) \frac{\partial\bar{\mathbf{g}}(t+\omega_{l})}{\partial\tilde{ \mathbf{y}}^{l}} \biggr\} \frac{\partial\mathbf{y}(t)}{\partial\eta_{j}}\,dt. \end{aligned}$$

(20)

Uniting (20) with (19) generates

$$ \begin{aligned} \frac{\partial J(\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\eta_{j}} &=\frac{\partial\Theta(\mathbf{y}(t_{1}),\ldots, \mathbf{y}(t_{p}),\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\eta_{j}} + \biggl\{ \frac{\partial\Theta(\mathbf{y}(t_{1}),\ldots,\mathbf{y}(t_{p}),\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\mathbf{y}(t_{p})} -\boldsymbol{\varrho}^{T} \bigl(t_{p}^{-} \bigr) \biggr\} \frac{\partial \mathbf{y}(t_{p})}{\partial\eta_{j}} \\ &\quad{} +\sum^{p-1}_{k=1} \biggl\{ \frac{\partial\Theta(\mathbf{y}(t_{1}),\ldots ,\mathbf{y}(t_{p}),\boldsymbol{\omega},\boldsymbol{\eta})}{\partial\mathbf{y}(t_{k})} -\boldsymbol{\varrho}^{T} \bigl(t_{k}^{-} \bigr)+\boldsymbol{\varrho}^{T} \bigl(t_{k}^{+} \bigr) \biggr\} \frac{\partial\mathbf{y}(t_{k})}{\partial\eta_{j}} \\ &\quad{}+ \int^{t_{p}}_{0} \biggl\{ \dot{\boldsymbol{ \varrho}}^{T}(t)+ \frac{\partial \bar{L}(t)}{\partial\mathbf{y}} +\boldsymbol{\varrho}^{T}(t) \frac{\partial\bar{\mathbf{g}}(t)}{\partial\mathbf{y}} \biggr\} \frac{\partial\mathbf{y}(t)}{\partial\eta_{j}}\,dt \\ &\quad{}+\sum^{m}_{l=1} \int^{0}_{-\omega_{l}} \biggl\{ \frac{\partial\bar {L}(t+\omega_{l})}{\partial\tilde{\mathbf{y}}^{l}} + \boldsymbol{\varrho}^{T}(t+\omega_{l}) \frac{\partial\bar{\mathbf{g}}(t+\omega_{l})}{\partial\tilde{ \mathbf{y}}^{l}} \biggr\} \frac{\partial\boldsymbol{\psi}(t,\boldsymbol{\eta})}{\partial \eta_{j}}\,dt \\ &\quad{}+\sum^{m}_{l=1} \int^{t_{p}-\omega_{l}}_{0} \biggl\{ \frac{\partial\bar {L}(t+\omega_{l})}{\partial\tilde{\mathbf{y}}^{l}} + \boldsymbol{\varrho}^{T}(t+\omega_{l}) \frac{\partial\bar{\mathbf{g}}(t+\omega_{l})}{\partial\tilde{ \mathbf{y}}^{l}} \biggr\} \frac{\partial\mathbf{y}(t)}{\partial\eta_{j}}\,dt \\ &\quad{}+ \int^{t_{p}}_{0} \biggl\{ \frac{\partial\bar{L}(t)}{\partial\eta_{j}} + \boldsymbol{\varrho}^{T}(t)\frac{\partial\bar{\mathbf{g}}(t)}{\partial\eta _{j}} \biggr\} \,dt +\boldsymbol{ \varrho}^{T} \bigl(0^{+} \bigr)\frac{\partial\boldsymbol{\psi}(0,\boldsymbol{\eta})}{\partial\eta_{j}}. \end{aligned} $$

Let $\boldsymbol{\varrho}= \boldsymbol{\lambda}(\cdot\mid\boldsymbol{\omega},\boldsymbol{\eta})$. Along with (6)-(8), then the above formula can be translated to (18). The proof can be completed. □

4 Application

Example 1

Consider a delayed epidemic model with the stage structure [12]

$$ \left \{ \textstyle\begin{array}{l} \dot{x}_{1}(t)=\frac{px_{2}(t)}{q+x_{2}^{n}(t)}-\gamma x_{1}(t)-e^{-\gamma \tau}\frac{px_{2}(t-\tau)}{q+x_{2}^{n}(t-\tau)},\\ \dot{x}_{2}(t)=e^{-\gamma\tau}\frac{px_{2}(t-\tau)}{q+x_{2}^{n}(t-\tau )}-\beta x_{2}(t)\frac{y(t)}{A+y(t)}-\eta x_{2}(t),\\ \dot{y}(t)=\beta x_{2}(t)\frac{y(t)}{A+y(t)}-\omega y(t)+u, \end{array}\displaystyle \right . $$

(21)

and

$$ x_{1}(t)=\varphi_{1}(t), \quad\quad x_{2}(t)= \varphi_{2}(t), \quad\quad y(t)=\varphi _{3}(t), \quad t \leq0. $$

(22)

The pest population is divided into egg, susceptible, and infective classes, with the size of each class given by $x_{1}(t)$, $x_{2}(t)$, and $y(t)$, respectively. The parameter τ represents a constant time to hatch, which mathematically is the delay in our model. For the pest egg population, the death rate is proportional to the existing pest egg population with a proportionality constant γ. The parameters η and ω represent the death rate of the susceptible pest population and, respectively, infective pest population. The expression $px_{2}(t)/(q+x_{2}^{n}(t))$ is a birth rates function of the susceptible pest population. The incidence rate is given by a function $\beta x_{2}(t)y(t)/(A+y(t))$, and $u>0$ is the release amount of infected pests which are bred in laboratories each time in order to drive target pests (susceptible pests) to catch an epidemic, or generate an endemic. Our aim is to find an admissible control pair ${(\tau, u )}$ that minimizes the following cost function:

$$ J(\tau,u)=\sum^{4}_{k=1}x_{2}^{2}(t_{k})+uT. $$

(23)

In (23), the terminal time is taken to be $T=20$, and the observation times for susceptible pest are scheduled at $t_{k}=5, 10, 15, 20$, $k=1,2,3,4$. The state delay τ and the release amount of infected pests u will be optimally selected to obtain the minimum pest level J at minimal cost in problem (23).

The auxiliary impulsive system for this problem is

$$ \begin{aligned} &\dot{\lambda}_{1}(t)=\gamma\lambda _{1}(t), \\ &\dot{\lambda}_{2}(t)= \biggl(\frac{\beta y(t)}{A+y(t)}+\eta \biggr)\lambda_{2}(t)-\frac{\beta y(t)}{A+y(t)}\lambda_{3}(t) \\ &\hphantom{dot{\lambda}_{2}(t)}{}+\frac{pq+(1-n)px_{2}^{n}(t)}{(q+x_{2}^{n}(t))^{2}} \bigl(e^{-\gamma\tau } \bigl( \lambda_{1}(t+\tau)-\lambda_{2}(t+\tau) \bigr) - \lambda_{1}(t) \bigr), \\ &\dot{\lambda}_{3}(t)=\frac{\beta Ax_{2}(t)}{(A+y(t))^{2}} \lambda_{2}(t) + \biggl(\omega-\frac{\beta Ax_{2}(t)}{(A+y(t))^{2}} \biggr)\lambda _{3}(t), \end{aligned} $$

(24)

with jump conditions

$$ \begin{aligned} &\lambda_{1} \bigl(t^{-}_{k} \bigr)= \lambda_{1} \bigl(t^{+}_{k} \bigr), \quad \quad \lambda _{2} \bigl(t^{-}_{k} \bigr)= \lambda_{2} \bigl(t^{+}_{k} \bigr)+2x_{2}(t_{k}), \\ & \lambda_{3} \bigl(t^{-}_{k} \bigr)= \lambda_{3} \bigl(t^{+}_{k} \bigr), \quad k=1, \ldots,4, \end{aligned} $$

(25)

and boundary conditions

$$ \lambda_{1}(t)=0, \quad\quad \lambda_{2}(t)=0, \quad\quad \lambda_{3}(t)=0,\quad t\geq 20. $$

(26)

By Theorems 1 and 2, the gradient formulas for this problem are

$$ \begin{aligned} &\frac{\partial J(\tau,u)}{\partial\tau} =e^{-\gamma\tau} \int^{T}_{\tau} \biggl\{ \frac{\gamma px_{2}(t-\tau )}{q+x_{2}^{n}(t-\tau)} + \frac{pq+(1-n)px_{2}^{n}(t-\tau)}{(q+x_{2}^{n}(t-\tau))^{2}}\dot {x}_{2}(t-\tau) \biggr\} \\ &\hphantom{\frac{\partial J(\tau,u)}{\partial\tau} =}{}\times \bigl\{ \lambda_{1}(t)-\lambda_{2}(t) \bigr\} \,dt, \\ &\frac{\partial J(\tau,u)}{\partial u} =T+ \int^{T}_{0}\lambda_{3}(t)\,dt. \end{aligned} $$

(27)

In order to get a minimum cost value, we try to choose the optimal time to hatch the pest egg population τ and release an amount of infected pests u. For this purpose, we will conduct the following numerical simulation.

For problem (23), take

$$ \begin{aligned} &p=1,\quad\quad q=0.2,\quad\quad n=2,\quad\quad \gamma=0.3,\quad\quad \beta=0.05, \\ &A=2, \quad\quad \eta=0.02,\quad\quad \omega=0.1, \quad\quad \tau=2,\quad\quad u=3. \end{aligned} $$

(28)

We solved the optimal problem by a Matlab program that integrates the SQP optimization method with equations (21)-(27). Starting with the initial guesses $\tau=2$ and $u=3$, we recover the optimal time to hatch the pest egg population $\tau^{*}= 4.999$ and release amount of infected pests $u^{*}= 0.196$, as well as the corresponding optimal cost value $J^{*}= 39.597$. The optimal cost value $J^{*}$ is less than $J=101.479$ under no optimal control strategy. Here the initial values of the populations are taken to be $\varphi_{1}(t)=3$, $\varphi_{2}(t)=4$, $\varphi_{3}(t)=1$. We impose the bound constraints on the state delay τ and the release amount of infected pests u as $0<\tau (\mbox{or } u)\leq5$.

We plot the comparisons of dynamic behaviors according to the optimal control $\tau^{*}= 4.999$, $u^{*}= 0.196$ as well as no optimal control $\tau=2$, $u=3$ (see Figures 1(a)-(d)). Exactly, (a), (b), and (c) are time-series of the egg, susceptible, and infective pest populations, respectively, when time varies from the first day to the 20th day. We conclude that the susceptible pest population decreases after using an optimal control strategy. Also, the infective pest population declines as a result of its optimal release amounts $u^{*}=0.196< u=3$. At the same time, the curve graph of the pest populations (egg, susceptible, and infective classes) is drawn in Figure 1(d).

Figure 1

Time-series of (a) the egg, (b) the susceptible, and (c) the infective pest population; (d) the curve graph of pest populations.

Example 2

Consider a competitive-predator model with stage structure and reserved area[13]:

$$ \left \{ \textstyle\begin{array}{l} \dot{u}_{1}(t)=\alpha_{1}e^{-\gamma_{1}\tau_{1}}u_{1}(t-\tau_{1})-\beta _{1}u_{1}^{2}-\theta_{1}u_{1}v+c_{2}u_{2}-c_{1}u_{1},\\ \dot{u}_{2}(t)=\alpha_{2}e^{-\gamma_{2}\tau_{2}}u_{2}(t-\tau_{2})-\beta _{2}u_{2}^{2}-\theta_{2}u_{2}v-c_{2}u_{2}+c_{1}u_{1},\\ \dot{v}(t)=\theta_{1}u_{1}v+\theta_{2}u_{2}v-dv, \end{array}\displaystyle \right . $$

(29)

and

$$ u_{1}(t)=\varphi_{1}(t),\quad\quad u_{2}(t)= \varphi_{2}(t), \quad\quad v(t)=\varphi _{3}(t), \quad t \leq0, $$

(30)

where $u_{1}(t)$ and $u_{2}(t)$ are the densities of prey species at time t on unreserved area and reserved area, respectively. The delays $\tau_{1}$ and $\tau_{2}$ are the times taken from birth to maturity of $u_{1}(t)$ and $u_{2}(t)$. The meanings $\alpha_{i}$, $\beta_{i}$ ($i=1,2$) are the same as in the literature [13]. Nevertheless, $\theta_{1}$ and $\theta_{2}$ are the predation rates of predator on two preys. The parameters $c_{1}$ (>0) and $c_{2}$ (>0) are the migration rates from the unreserved area to the reserved area and the reserved area to the unreserved area, respectively. d is the death rate of the predator population. Let $\boldsymbol{\tau}= (\tau_{1}\ \tau_{2} )^{T}$, $\mathbf{c}= (c_{1}\ c_{2} )^{T}$. Our aim is to obtain a maximum harvest with respect to the prey and predator populations at the harvesting time T. Thus, the objective function is

$$ J(\boldsymbol{\tau},\mathbf{c})=u_{1}(T)+u_{2}(T)+v(T). $$

(31)

Assume that the harvesting time for prey and predator populations is scheduled at $T=30$. We will optimally select the state delays $\tau_{1}$, $\tau_{2}$ and the migration rates $c_{1}$, $c_{2}$ to obtain the maximum harvest J at the observation time in problem (31).

The auxiliary impulsive system for this problem is

$$\begin{aligned}& \dot{\lambda}_{1}(t)= (2\beta_{1}u_{1}+ \theta_{1}v+c_{1} )\lambda_{1}(t) -c_{1}\lambda_{2}(t)-\theta_{1}v \lambda_{3}(t)-\alpha_{1}e^{-\gamma_{1}\tau _{1}} \lambda_{1}(t+\tau_{1}), \\& \dot{\lambda}_{2}(t)=-c_{2}\lambda_{1}(t)+ (2 \beta _{2}u_{2}+\theta_{2}v+c_{2} ) \lambda_{2}(t) -\theta_{2}v\lambda_{3}(t)- \alpha_{2}e^{-\gamma_{2}\tau_{2}}\lambda _{2}(t+\tau_{2}), \\& \dot{\lambda}_{3}(t)=\theta_{1}u_{1} \lambda_{1}(t)+\theta_{2}u_{2}\lambda _{2}(t)+ (d-\theta_{1}u_{1}-\theta_{2}u_{2} )\lambda_{3}(t), \end{aligned}$$

(32)

with jump conditions

$$ \lambda_{1} \bigl(T^{-} \bigr)=\lambda_{1} \bigl(T^{+} \bigr)-1,\quad\quad \lambda_{2} \bigl(T^{-} \bigr)= \lambda_{2} \bigl(T^{+} \bigr)-1,\quad\quad \lambda_{3} \bigl(T^{-} \bigr)= \lambda_{3} \bigl(T^{+} \bigr)-1, $$

(33)

and boundary conditions

$$ \lambda_{1}(t)=0,\quad\quad \lambda_{2}(t)=0,\quad\quad \lambda_{3}(t)=0,\quad t\geq 30. $$

(34)

According to Theorems 1 and 2, the gradients of J with respect to $\tau_{1}$, $\tau_{2}$, $c_{1}$, and $c_{2}$ are

$$ \begin{aligned} &\frac{\partial J(\boldsymbol{\tau},\mathbf{c})}{\partial\tau_{1}} =- \int^{T}_{\tau_{1}}\alpha_{1}e^{-\gamma_{1}\tau_{1}} \lambda_{1}(t) \bigl\{ \gamma_{1}u_{1}(t- \tau_{1})+\dot{u}_{1}(t-\tau_{1}) \bigr\} \,dt, \\ &\frac{\partial J(\boldsymbol{\tau},\mathbf{c})}{\partial\tau_{2}} =- \int^{T}_{\tau_{2}}\alpha_{2}e^{-\gamma_{2}\tau_{2}} \lambda_{2}(t) \bigl\{ \gamma_{2}u_{2}(t- \tau_{2})+\dot{u}_{2}(t-\tau_{2}) \bigr\} \,dt, \\ &\frac{\partial J(\boldsymbol{\tau},\mathbf{c})}{\partial c_{1}} = \int^{T}_{0}u_{1} \bigl\{ \lambda_{2}(t)-\lambda_{1}(t) \bigr\} \,dt, \\ &\frac{\partial J(\boldsymbol{\tau},\mathbf{c})}{\partial c_{2}} = \int^{T}_{0}u_{2} \bigl\{ \lambda_{1}(t)-\lambda_{2}(t) \bigr\} \,dt. \end{aligned} $$

(35)

Let us ask how to optimally choose the times taken from birth to maturity $\tau_{1}$, $\tau_{2}$ and the migration rates $c_{1}$, $c_{2}$ to get the highest level of population at harvesting time in a period. For this purpose, we will conduct the following numerical simulation.

In the same way, for problem (31), take

$$ \begin{aligned} &\alpha_{1}=0.5,\quad\quad \alpha_{2}=1, \quad\quad \beta_{1}=0.1,\quad\quad \beta_{2}=0.2, \quad\quad \theta _{1}=0.4, \\ & \theta_{2}=0.3,\quad\quad d=0.3,\quad\quad \gamma_{1}=0.02, \quad\quad \gamma_{2}=0.01, \quad\quad \tau_{1}=1, \\ & \tau_{2}=2, \quad\quad c_{1}=0.3, \quad\quad c_{2}=0.4. \end{aligned} $$

(36)

We solved this problem utilizing the same Matlab program as was used to solve the above example. Similarly, for the initial guess $\tau _{1}=1$, $\tau_{2}=2$, $c_{1}=0.3$, and $c_{2}=0.4$, we obtained the optimal periods of maturity $\tau_{1}^{*}= 3.241$, $\tau_{2}^{*}=2.458$, and migration rates $c_{1}=0.553$, $c_{2}=0.411$, as well as the maximum yield $J^{*}=4.272$. The maximum yield $J^{*}$ is higher than $J=3.218$ under no optimal control strategy, which is exactly what we expected. Here the initial values of populations are taken to be $\varphi_{1}(t)=2$, $\varphi_{2}(t)=2$, $\varphi_{3}(t)=3$. The bound constraints of the state delays as well as the migration rates are $0<\tau_{1}(\mbox{or }\tau_{2} )\leq5$ and $0< c_{1}(\mbox{or }c_{2} )\leq1$, respectively.

Figures 2(a)-(c) show that the comparisons of dynamic behaviors of the prey and predator populations, respectively, according to the optimal control $\boldsymbol{\tau}^{*}= (3.241 \ 2.458 )^{T}$, $\mathbf{c}^{*}= (0.553\ 0.411 )^{T}$, and no optimal control $\boldsymbol{\tau}= (1\ 2 )^{T}$, $\mathbf{c}= (0.3\ 0.4 )^{T}$. It is observed that the prey population on unreserved area and reserved area increases after using optimal control strategy. Also, Figure 2(c) implies that the predator population goes up as the time varies from the first day to the 30th day. The curve graph of prey and predator populations also proves our ideas (see Figure 2(d)).

Figure 2

Time-series of (a) the prey population on unreserved area, (b) the prey population on reserved area, and (c) the predator population; (d) the curve graph of prey and predator populations.

5 Conclusion

In pest control, taking the lag of parasitic eggs, the lag effect of pesticide poisoning, and the age of releasing natural enemies as control variables, combined with the crop fertility cycle, researches on the optimization problem of pest control models at seedling stage, bud stage, and filling stage of crops fill in a gap. For these purposes, a generalized hybrid optimization problem involving state delay with characteristic time and parameter control is presented. Then an algorithm based on a gradient computation is given. Finally, two examples in an agroecological system are given to exhibit the effectiveness of the proposed optimization algorithm.