 Research
 Open access
 Published:
Optimal selection of injection doses and injection timings for insulin therapy in a limited time
Advances in Difference Equations volumeÂ 2020, ArticleÂ number:Â 653 (2020)
Abstract
In this paper, we study the injection strategies of insulin for the impulsive therapy of diabetes in a limited time. According to whether we consider the risk of hypoglycemia or not, we develop two different control objectives and investigate three different injection strategies for each control objective. We apply a timerescaling method to overcome technical obstacles in optimal impulsive control and compute the gradient formulas of cost functions with respect to injection doses and injection timings. By means of numerical simulations we get the optimal injection doses and injection timings for each injection strategy. Our study indicates that for the control objective without considering the risk of hypoglycemia, the optimal injection timing control is more effective than the optimal injection dose control, whereas the mixed control achieves almost the same effect as the optimal injection timing control. For the other control objective considering the risk of hypoglycemia, the optimal injection timing control performs better than the optimal injection dose control in avoiding emergence of hypoglycemia, and the mixed control provides the best strategy in preventing hyperglycemia from occurrence.
1 Introduction
Over the last few decades, diabetes mellitus has been a leading public health concern due to the overwhelming number of people living with this disease and large amounts of money (245 billion dollars in the US in 2012) spent in medical care [28]. Diabetes mellitus is a metabolic disorder, which is characterized by high plasma glucose level over a prolonged period, which may lead to frequent urination and increased thirst and hunger. If not treated, it can cause severe longterm complications such as diabetic ketoacidosis, cardiovascular disease, stroke, and chronic kidney disease. In general, diabetes is caused by either the pancreas producing insufficient insulin (type 1 diabetes) or the cells of the body not responding properly to the insulin produced (type 2 diabetes). Insulin therapy is an effective way for both types of diabetics to control high plasma glucose.
Insulin pump is a very common medical device, which can administrate insulin and its analogues. The use of it has highly improved the living quality of the patient compared with manual syringe [6, 9, 10, 13, 22, 25â€“27, 29]. Patients can determine the injection dose and injection timing when using an insulin pump. However, patientsâ€™ lifestyle is affected since their carbohydrate intake is severely restricted and the dose of injected insulin is carefully computed to avoid occurrence of both hyperglycemia and hypoglycemia [13, 22]. That is why in recent years, more and more researchers are attracted to develop an artificial pancreas, which can provide the substitute endocrine functionality of a real and healthy pancreas [11â€“13, 30, 31].
Mathematical models are important tools to study insulin therapy for diabetes because they can deepen the understanding of the pharmacological mechanism and the changing regularity of the plasma glucose concentration. For example, some researchers studied the glucoseâ€“insulin regulatory system of healthy people [4, 7, 17, 32, 34], whereas others concentrated on the insulin sensitivity [5, 8, 16, 23]. Delay differential equation models were proposed in [15, 18, 35, 36] to reveal the reason of the sustained oscillations of the endocrine metabolic system. Doran et al. [3] investigated the insulin infusion process for critically ill patients in ICU. To mimic the relatively transient behavior of insulin injection, impulsive different equation models were formulated in [12, 13, 29] to study the glucoseâ€“insulin regulatory system with insulin therapy.
It is more important to keep the plasma glucose level under control with small fluctuations than to blindly lower it because of the risk of hypoglycemia, since hypoglycemia is much more dangerous than hyperglycemia. Optimal control is an invaluable mathematical tool to investigate injection strategies of insulin. By using optimal control theory it is entirely possible to achieve the goal of making the glucose level under control with small fluctuations while minimizing the treatment cost.
Since the state variables are affected by uncertain pulse jumps, there is technical difficulty in solving the optimal control problem governed by a switched impulsive dynamical system. To overcome such a difficulty, some work has been done, and several available methods have been applied to the optimal management in many fields [14, 19, 24, 33]. For example, the authors in [19] investigated and assessed various optimal strategies for a multipopulation model with epidemic and impulsive interventions, whereas in [24], different optimal release strategies of natural enemies for a pest management systems were studied.
In this paper, we formulate a mathematical model for the plasma glucose control in a limited time and investigate the optimal injection strategies of insulin based on specific control objectives. The rest of this paper is organized as follows. In Sect.Â 2, we formulate a model for the limited time control of plasma glucose with impulsive injection of insulin. In Sect.Â 3, we take into account both the fluctuations of plasma glucose level and the amount of insulin injected, and set two different control objectives according to whether we consider the risk of hypoglycemia or not. Then for each control objective, we investigate three different limitedtime optimal injection strategies, and by using a time rescaling method we obtain the gradients of cost function with respect to all control parameters. In Sect.Â 4, we perform a series of numerical simulations to determine the optimal values of the injection timings and injection doses. Finally, we present a brief conclusion in Sect.Â 5.
2 Model formulation
Most theoretical studies on insulin therapy focused on the asymptotic behaviors of dynamical systems, which are applicable to longterm control of the the plasma glucose level. However, if the plasma glucose concentration is much higher than the normal level, then to avoid permanent damage of patientâ€™s health, treatment should be taken to lower glucose concentration to a tolerable level in a short time. To the best of our knowledge, very few works on the limited time control of glucose concentration have been done. The work [20] studied a finitetime control of the plasma glucose level, which focuses on the glucose level at the terminate time of control but ignores the fluctuation during the control process. It is worth pointing out that the ignorance of extreme fluctuations of glucose concentration during control process may have undesirable consequences in the clinic.
Li, Kuang, and Mason [15, 17] proposed mathematical models obeying the mass conservation law to simulate the glucoseâ€“insulin regulation system. Then Song, Huang, and Li [29] developed these models by incorporating three physiological time delays and periodic impulsive deliveries of insulin and formulated the system as follows:
with \(G(0)=G_{0}>0\) and \(I(0)=I(0^{+})=I_{0}>0\), where \(G(t)\) and \(I(t)\) represent the concentrations of the glucose and insulin at time t, respectively, \(G_{in}\) denotes the glucose input, \(f_{1}(G)\) stands for the insulin secretion with elevated glucose concentration, \(f_{2}(G)\) represents the glucose uptake, which is independent of insulin, \(f_{3}(G)f_{4}(I)\) stands for the glucose utilization, which is dependent on insulin, \(f_{5}(I)\) is the hepatic glucose production (HGP), \(\tau _{t}\), \(\tau _{m}\), \(\tau _{h}\) are physiological time delays in the glucoseâ€“insulin regulation system, and \(d_{i}>0\) is the degradation rate of insulin. For the periodic impulsive deliveries of insulin, Ïƒ is the injection dose, whereas p is the delivery period.
Song et al. [29] focused on the study of the asymptotical behavior of the plasma glucose level after sufficiently long time of insulin treatment. However, it is of more clinical significance to consider the optimal limitedtime control problem of glucose, that is, to determine the most efficient strategy of limitedtime insulin injection at the minimal economic cost. For this purpose, we ignore the impact of the physiological time delays and formulate the following system incorporating limitedtime control of glucose and impulsive deliveries of insulin:
where T is a predefined adjustable constant, which represents the time length of control, \(t_{i}\), \(i=1,2,\ldots , N1\), are the injection moments of insulin, which satisfy \(0\leq t_{1}\leq t_{2}\leq \cdots \leq t_{N1}\leq t_{N}=T\), whereas \(\sigma _{i}\) (Î¼U/ml) >0 is the injection dose at \(t=t_{i}\). Assume that the upper and lower bounds of the plasma glucose concentration that people can tolerate are A and B, respectively. If the plasma glucose concentration is kept within \([B, A]\), then both hypoglycemia and hyperglycemia can be avoided. We denote the ideal level of plasma glucose by \(\alpha A+\beta B\), where \(\beta \in [0,1]\) and \(\alpha + \beta =1\).
Our aim in this paper is finding a method to determine the optimal injection moments and injection doses that can not only maintain the plasma glucose concentration at an idea level, but also minimize the treatment cost.
3 The optimal control problem
In this section, we present the optimal control problem about the plasma glucose by analyzing system (2). There are two key points we need to pay attention to. The first one is the medical cost. As is well known, there is no cure for diabetes mellitus, so if a person is diagnosed with diabetes, then a lifelong treatment is needed. Thus it is very important to reduce the medical cost as much as possible. The other thing that we are concerned about is the glucose fluctuation during therapy. This is directly related to the treatment effect. The ultimate goal of the treatment is to lower the plasma glucose concentration to normal level as soon as possible by injecting insulin or its analogues. We also need to ensure that the glucose level is not too high or too low, that is, the deviation from normal level should not be too large.
Based on the above considerations, the problem in this paper can be stated as finding the optimal control parameter \(\sigma _{i}>0\) and injection timings \(t_{i}\in [0,T]\) minimizing the cost function
or
where \(l_{0}\) is the unit price of insulin or its analogues, and \(l_{1}\), \(l_{2}\) are the balance factors between the glucose level and insulin cost in objective functions.
Remark 1
In insulin therapy, especially for the critically ill patients, besides hyperglycemia, hypoglycemia can also occur when a patient misses a meal or an overdose of insulin is injected. Compared to hyperglycemia, hypoglycemia is certifiably more dangerous to human health and can cause serious complications such as brain damage and quick unexpected death [12]. So in the second control objective, we particularly consider reducing the likelihood of hypoglycemia.
In the following, we study three different kinds of impulsive injection strategies.
3.1 Optimization by injection timing and injection dose
Let \(\tau _{i}=t_{i}t_{i1}\) and
where \(\tau _{i}^{1}\) and \(\tau _{i}^{2}\) are given constants that represent the lower and upper bounds of the time interval between the \((i1)\)th and ith injections. Assume that the injection dose \(\sigma _{i}\) satisfies
where \(\sigma _{i}^{1}\) and \(\sigma _{i}^{2}\) are also given constants that represent the lower and upper bounds of the ith injection dose.
Define the vectors \(\mathfrak{P}_{1}=(\tau _{1}, \tau _{2}, \ldots ,\tau _{N})^{T}\) and \(\mathfrak{P}_{2}=(\sigma _{1}, \sigma _{2}, \ldots ,\sigma _{N1})^{T}\), where \(\tau _{i}\) and \(\sigma _{i}\) satisfy conditions (5) and (6), respectively. Let \(\Omega _{1}\) and \(\Omega _{2}\) be the sets of all \(\mathfrak{P}_{1} \in R^{N}\) and \(\mathfrak{P}_{2}\in R^{N1}\) satisfying (5) and (6), respectively.
Since the mapping defined by the righthand side of system (2) is smooth, this impulsive system has a unique solution \((G(t), I(t))^{T}\) corresponding to each pair \((\mathfrak{P}_{1},\mathfrak{P}_{2})\in (\Omega _{1},\Omega _{2})\) [1, 2].
Then the cost functions in (3) and (4) can be rewritten as
and
For the control of plasma glucose, we raise the following optimal control problem:
\(\mathbf{{(P_{A})}}\): For the insulin treatment system (2), find a parameter vector pair \((\mathfrak{P}_{1},\mathfrak{P}_{2})\in (\Omega _{1},\Omega _{2})\) such that the cost function \(J_{1}(\mathfrak{P}_{1},\mathfrak{P}_{2})\) or \(J_{2}(\mathfrak{P}_{1},\mathfrak{P}_{2})\) is minimized.
Since the state variables \(G(t)\) and \(I(t)\) are affected by uncertain pulse effects (uncertain injection timing \(t_{i}\) and uncertain injection dose \(\sigma _{i}\)), this problem cannot be directly solved by currently available optimization techniques. To overcome such a difficulty, we introduce a timescaling transform method (cf. Lee [14], Teo [33], Liang [19], and Pei [24]) and translate these uncertain pulse time points into fixed ones. Then the optimal control problem \((\mathbf{P_{A})}\) is transformed into an equivalent optimal parameter selection problem, which is regulated by an ordinary differential equation system with periodic boundary conditions.
According to system (2), let \(t=t_{i1}+(t_{i}t_{i1})s=\sum_{j=1}^{i1}\tau _{j}+\tau _{i} s\) for \(t\in (t_{i1}, t_{i}]=(\sum_{j=1}^{i1}\tau _{j}, \sum_{j=1}^{i} \tau _{j}]\) and define
where \(0< s\leq 1\), \(i=1,2,\ldots ,N\), and \(t_{0}=0\).
Then system (2) is transformed into the following N subsystems:
with initial and boundary conditions
and
Subject to system (10)â€“(12), the cost functions (7) and (8) are transformed into equivalent new forms
and
Then the optimal control problem \({(\mathbf{P_{A})}}\) is translated into
\(\mathbf{{(P_{B})}}\) For the insulin treatment system (10) with conditions (11) and (12), find a parameter vector pair \((\mathfrak{P}_{1},\mathfrak{P}_{2})\in (\Omega _{1},\Omega _{2})\) such that the cost function \(\hat{J}_{1}(\mathfrak{P}_{1},\mathfrak{P}_{2})\) or \(\hat{J}_{2}(\mathfrak{P}_{1},\mathfrak{P}_{2})\) is minimized.
It is easy to verify that this optimal parameter selection problem is equivalent to the previous optimal control problem. In the following, we only need to find parameters \(\sigma _{i}\) and \(\tau _{i}\) that satisfy the requirements.
Note that for given parameters \(\sigma _{i}\) and \(\tau _{i}\), the initial conditions of the dynamical systems (10)â€“(12) are all determined. We easily see that the initial state value \((G^{i+1}(0),I^{i+1}(0))\) of \((G^{i+1}(s),I^{i+1}(s))\) depends on the state value \((G^{i}(1),I^{i}(1))\) of \((G^{i}(s),I^{i}(s))\) at \(s= 1\). Thus for the optimization procedure, we first get \((G^{1}(s),I^{1}(s))\), \(0\leq s\leq 1\) by solving the dynamical systems (10)â€“(12) when \(i= 1\). According to (12), \((G^{1}(1),I^{1}(1))\) is the initial value \((G^{2}(0),I^{2}(0))\) when \(i = 2\). With this initial condition, we can further calculate \((G^{2}(s),I^{2}(s))\), \(0< s\leq 1\). Repeat this procedure until \((G^{N}(s),I^{N}(s))\), \(0< s\leq 1\), is obtained.
To solve the above optimization problem, we can apply the gradientbased optimization techniques as in [24]. In what follows, we discuss the gradient information of the objective function \(\hat{J}_{m}\), \(m=1,2\), with respect to the control parameters \(\tau _{i}\) and \(\sigma _{i}\).
To apply Pontryaginâ€™s maximum principle, we set
and then from (12) easily get
Now we consider the first kind of cost function, that is, when \(\hat{J}=\hat{J}_{1}\). Define the Hamiltonian function for this optimization problem as follows:
where
and \(\lambda ^{i}=(\lambda _{1}^{i}(s),\lambda _{2}^{i}(s))^{T}\) is the corresponding costate governed by the following backward initialboundaryvalue problem:
with
For the second kind of control, that is, when \(\hat{J}=\hat{J}_{2}\), the expression of the Hamiltonian function (15) remains unchanged, but due to the difference between \(\hat{J}_{1}\) and \(\hat{J}_{2}\), the expression of \(H_{i}\) becomes
and the corresponding costate \(\lambda ^{i}=(\lambda _{1}^{i}(s),\lambda _{2}^{i}(s))^{T}\) takes the form
with initialboundaryvalue condition (18).
Then by the results in [21] we can obtain the following expressions for gradients of the cost function \(\hat{J}_{m} (\mathfrak{P}_{1},\mathfrak{P}_{2})\), \(m=1,2\), with respect to the injection timing \(\tau _{i}\) and injection dose \(\sigma _{l}\).
Theorem 3.1
For the cost functions
defined in (13) and (14), the gradients with respect to \(\sigma _{i}\), \(i=1,2,\ldots ,N1\), are given by
whereas the gradients with respect to \(\tau _{k}\), \(k=1,2,\ldots ,N\), are given by
where \(\lambda _{l}^{n}(s)\), \(i=1,2\), \(n=1,2,\ldots ,N\), can be obtained from equations (17) and (20) for \(\hat{J}_{1}\) and \(\hat{J}_{2}\), respectively.
3.2 Optimization by injection dose for periodic injection
In this subsection, we consider a simple scenario in clinic. Suppose that the same dose (denoted by \(\sigma _{d}\)) of insulin or its analogues is periodically injected during the limited time \([0,T]\) and \(N1\) injections are totally planed. Then the injection period is \(\tau =\frac{T}{N}\), that is, a fixed amount \(\sigma _{d}\) of insulin or its analogues is periodically injected into the plasma at the moments iÏ„, \(i=1,2,\ldots ,N1\). Hence system (2) has the following form:
We also assume that the injection dose \(\sigma _{d}\) satisfies
where \(\sigma _{d}^{1}\) and \(\sigma _{d}^{2}\) are given constants that represent the lower and upper bounds of the fixed injection dose.
Then for this scenario, the cost function of control problem \((\mathbf{P_{A})}\) becomes
or
Here \(\sigma _{d}\) is the unique control parameter. We need to find an injection dose \(\sigma _{d} \in [\sigma _{d}^{1}, \sigma _{d}^{2}]\) such that \(\tilde{J}_{1}(\sigma _{d})\) or \(\tilde{J}_{2}(\sigma _{d})\) is minimized.
Just as in Sect.Â 3.1, for \(i=1,2,\ldots , N\), let \(t=(i1)\tau +s\tau \). Then system (23) is converted into the following N subsystems:
with initial condition (11) and
The cost functions (25) and (26) are then equivalently transformed into
and
Therefore the optimal problem can be described as follows: find \(\sigma _{d} \in [\sigma _{d}^{1}, \sigma _{d}^{2}]\) such that \(\hat{\tilde{J}}_{1}(\sigma _{d})\) or \(\hat{\tilde{J}}_{2}(\sigma _{d})\) is minimized.
Using the Hamiltonian function defined in (15) and (16), we obtain the following costate equations associated with \(\hat{\tilde{J}}_{1}(\sigma _{d})\):
with initialboundaryvalue condition (18).
According to the Hamiltonian function defined in (15) and (19), we get the following costate equations corresponding to \(\hat{\tilde{J}}_{2}(\sigma _{d})\):
with initialboundaryvalue condition (18).
Denote
From (23) it follows that
Applying the results in [21] again, we get the following result.
Theorem 3.2
For the cost functions \(\hat{\tilde{J}}_{m}(\sigma _{d})\), \(m=1,2\), defined in (29) and (30), the gradient with respect to the injection dose \(\sigma _{d}\) is given by
3.3 Optimization by injection timings for a given injection dose
In this subsection, we consider another simple scenario in clinic. Assume that insulin or its analogues is injected at irregular moments \(0\leq t_{1}\leq t_{2}\leq \cdots \leq t_{N1}\leq T\) with the same injection dose \(\sigma _{d}\). The injection dose \(\sigma _{d}\) and injection timings \(t_{1}, t_{2},\ldots , t_{N1}\) are all decision variables. Then system (2) is converted into the following form:
Here the injection timings \(t_{i}\), \(i=1,2,\ldots , N\), and injection dose \(\sigma _{d}\) satisfy conditions (5) and (24), respectively.
Then the cost function in control problem \((\mathbf{P_{A})}\) is translated into
or
where \(\mathfrak{P}_{1}=(\tau _{1}, \tau _{2}, \ldots ,\tau _{N})^{T}\), \(\tau _{i}=t_{i}t_{i1}\).
Let \(t=\sum_{j=1}^{i1}\tau _{j}+\tau _{i} s\) for \(i=1,2,\ldots , N\), and transform system (34) into
with initial and boundary conditions (11) and (28).
Cost functions (35) and (36) are converted to
and
The optimal problem can be restated as follows: find \(\mathfrak{P}_{1} \in \Omega _{1}\) and \(\sigma _{d} \in [\sigma _{d}^{1}, \sigma _{d}^{2}]\) such that \(\hat{\bar{J}}_{1}(\mathfrak{P}_{1}, \sigma _{d})\) or \(\hat{\bar{J}}_{2}(\mathfrak{P}_{1}, \sigma _{d})\) is minimized.
Similarly to Sects.Â 3.1 and 3.2, we apply the Hamiltonian function defined in (15) and (16) and obtain the same costate equations (17) with initialboundaryvalue condition (18) corresponding to \(\hat{\bar{J}}_{1}(\mathfrak{P}_{1}, \sigma _{d})\).
Using the Hamiltonian function defined in (15) and (19), we get the costate equations (20) with initialboundaryvalue condition (18) corresponding to \(\hat{\bar{J}}_{2}(\mathfrak{P}_{1}, \sigma _{d})\).
The following conclusion can be drawn by the same method as in the preceding two subsections.
Theorem 3.3
For the cost functions \(\hat{\bar{J}}_{m}(\mathfrak{P}_{1}, \sigma _{d})\), \(m=1,2\), defined in (38) and (39), the gradient with respect to the injection dose \(\sigma _{d}\) is given by
whereas the gradients with respect to the injection doses \(\tau _{k}\), \(k=1,2,\ldots , N\), are given by
4 Optimal injection strategies and numerical simulations
In this section, we perform a series of numerical simulations for systems (2), (23), and (34), which not only confirm the results obtained in Sect.Â 3, but complement those results with some specific features. We will determine the optimal values of the injection doses and injection timings that can keep the plasma glucose under control with smaller oscillations and less treatment cost.
To begin with, we will present a stepbystep algorithm for the computation of the cost function and its gradient at a given feasible pair \((\mathfrak{P}_{1},\mathfrak{P}_{2})\in (\Omega _{1},\Omega _{2})\) [21, 24]. We take the case in Sect.Â 3.1 as an example.

(i)
We first solve directly the dynamical system (10) with initial and boundary conditions (11) and (12) for \(i=1, 2,\ldots ,N\) to obtain \(G_{i}(s)\), \(I _{i}(s)\), \(s\in [0,1]\).

(ii)
Applying \(G_{i}(s)\) and \(I _{i}(s)\) obtained in the last step, we solve backwards the costate system (17) with boundary conditions (18) and the costate system (20) with boundary conditions (18), and get \(\lambda _{1}^{i}(s)\) and \(\lambda _{2}^{i}(s)\) for \(i=1, 2,\ldots ,N\).

(iii)
According to (13) and (14), we evaluate the cost functions \(\hat{J}_{m}(\mathfrak{P}_{1},\mathfrak{P}_{2})\), \(m=1,2\), by using \(G_{i}(s)\) and \(I_{i}(s)\).

(iv)
Applying \(G_{i}(s)\), \(I _{i}(s)\), \(\lambda _{1}^{i}(s) \), and \(\lambda _{2}^{i}(s)\), we compute \(\nabla _{\tau _{i}}\hat{J}_{m}(\mathfrak{P}_{1},\mathfrak{P}_{2})\) for \(i=1, 2,\ldots ,N\) and \(\nabla _{\sigma _{l}}\hat{J}_{m}(\mathfrak{P}_{1},\mathfrak{P}_{2})\) for \(l=1, 2,\ldots ,N1\).
As mentioned in [13] and [29], it is more important to choose the geometrical shapes of the five response functions \(f_{i}\), \(i=1, \ldots ,5\), in systems (1) and (2) than their specific expressions. To satisfy geometric properties of these functions introduced in [13] and [29], we select the following forms of \(f_{i}\), \(i=1,\ldots ,5\), as Song et al. [29] did:
Here \(\sigma _{1}\), \(\sigma _{2}\), \(\alpha _{1}\), a, c, m, n, R, v, and Ä‰ are positive constants, and their values are chosen from [15, 17, 18] (see TableÂ 1), whereas we assume that the maximum secretory rate of the diabetics is about 3% of normal subjects. Besides, we select the upper and lower limits of the plasma glucose concentration that people can tolerate as \(A=200\text{ mg/dl}\) and \(B=50\text{ mg/dl}\), respectively, and the weight parameters are selected as \(\alpha =\frac{1}{3}\) and \(\beta =\frac{2}{3}\). The unit price of insulin and the balance factors are chosen as \(l_{0}=0.005\) and \(l_{1}=l_{2}=0.01\). For convenience, unit conversion has been made from amounts to concentrations in the same way as in [15, 17], and [13].
By simple calculation we get
and according to equation (10), we have
Then equations (17) and (20) can be transformed respectively into
and
We will look for the optimal values of the control parameters in different injection modes by using Matlab programs. We use minutes as time units and take 240 min as the total control time, that is, \(T = 240\) min. Four injections of insulin are planed and these 240 min will be divided into five segments (\(N = 5\)).
In the following, we will study three different optimal strategies in impulsive control for each cost function by numerical simulations. Surely, there is no guarantee that the optimal solution we find numerically is unique, so we just present some optimal ones with special initial injection periods and doses by the above steps.
Due to the difference between two types of cost function, the costate equations are different, and so are the corresponding gradient formulas of the cost function with respect to control parameters. We will discuss the optimal injection strategies in two cases.
4.1 Optimal injection strategies for the first cost function
4.1.1 Optimal injection dose for periodic injection
We first consider the optimization of injection dose for periodic injection, that is,
Starting with an initial injection dose \(\sigma _{d}=130\), if only simple impulsive releases are used without any optimal control, then we obtain that after five periods the cost value is \(\tilde{\mathcal{J}}_{1}= 145.3126 \) and the plasma glucose level at the terminal time is \(G(T)=106.83\text{ mg/dl}\).
Under the constraint \(80\leq \sigma _{d} \leq 200\), we solve the corresponding optimal problem by the algorithm listed above in Matlab. We get the optimal injection dose \(\sigma ^{*}_{d}=133.564\), the corresponding cost value \(\tilde{\mathcal{J}}_{1}^{*}=145.1660\), and the plasma glucose level at the terminal time is \(G^{*}(T)=105.74\text{ mg/dl}\). After comparing the time series diagrams of plasma glucose level for this kind of optimal control, noncontrol and simple impulsive control in Fig.Â 1(a), we find that this optimal control strategy has a very small advantage in lowering plasma glucose concentration. It is worth pointing out that it costs a little more insulin to achieve such an effect (see TableÂ 2).
In addition, we investigate the influence of injection dose on the cost function and the glucose concentration at time T (see Figs.Â 1(b) and (c)), and find that when the injection dose varies within the interval \(80\leq \delta _{d} \leq 200\), the cost function \(\tilde{\mathcal{J}}_{1}(\delta _{d})\) admits a minimum point, which verifies the optimum results we obtained. Furthermore, note that the plasma glucose level at the terminal time T continues decreasing with the increase of the injection dose. We depict the optimal control laws in Fig.Â 1(d).
4.1.2 Optimal injection timings with fixed injection dose
To be consistent with Sect.Â 4.1.1, we choose the same initial injection dose \(\sigma _{d}=130\) and select \(\tau _{1}=24\), \(\tau _{2}=\tau _{3}=\tau _{4}=48\), and \(\tau _{5}=72\) as the initial injection intervals. Besides, to determine the optimal time intervals \(\tau _{i}\) and optimal injection dose \(\sigma _{d}\) minimizing the cost function \(\bar{\mathcal{J}}_{1}\), we consider the constraint conditions
and \(80\leq \sigma _{d}\leq 200\).
Then solving this optimal problem in Matlab, we obtain the following optimal injection intervals:
and the optimal injection dose
In addition, we get the minimum cost value \(\bar{\mathcal{J}}_{1}^{*}=123.8571\) and the plasma glucose level at the terminal time \(G^{*}(T)=171.67\text{ mg/dl}\).
We also plot the time series diagrams of the plasma glucose level for the optimal injection timing control, optimal injection dose control, and noncontrol in Fig.Â 2(a). We can see from the comparison of these curves that the optimal injection timing control has obvious advantage since it achieves a better glucose control effect with relatively low cost function value. Besides, for every \(\sigma _{d} \in [80,200]\), we determine the corresponding optimal time intervals under restriction (44) and then calculate the value of the cost function and the plasma glucose concentration at time \(T=240\). From Fig.Â 2(b) we see that when the injection dose varies within the interval \(80\leq \sigma _{d} \leq 200\), the cost function \(\bar{\mathcal{J}}_{1}(\mathfrak{P}_{1}, \sigma _{d})\) also admits a minimum point. This further confirms the optimum values we have obtained. Similarly, the plasma glucose level at the terminal time T also keeps decreasing with the increase of the injection dose (see Fig.Â 2(c)). Graphical output in Fig.Â 2(d) directly displays our optimal injection timing control strategy expressed by (45) and (46).
4.1.3 Optimal injection timings and injection doses
Keeping the same initial injection intervals \(\tau _{1}=24\), \(\tau _{2}=\tau _{3}=\tau _{4}=48\), and \(\tau _{5}=72\) and choosing the initial injection dose \(\sigma _{1}=\sigma _{2}=\sigma _{3}=\sigma _{4}=130\), we deal with the optimal problem with constraints (44) and \(80\leq \delta _{i}\leq 200\), \(i=1,2,3,4\). Then after solving this optimal problem, we obtain the set of optimal injection doses
and the set of optimal injection intervals
This injection strategy is shown by Fig.Â 3(b). Besides, we obtain that the minimum cost value \(\mathcal{J}_{1}^{*}=123.9197\) and the plasma glucose level at the terminal time is \(G^{*}(T)=174.24\text{ mg/dl}\). The time series diagrams of the plasma glucose level under four types of control modes are plotted in Fig.Â 3(a), and we can see that the mixed optimal control produces almost the same effect as the optimal injection timing control in this view.
Finally, we compare these three optimal injection strategies to evaluate their effectiveness (refer to TableÂ 3 and Fig.Â 4). We find that the optimal injection timing control is superior to the optimal injection dose control because of the lower glucose level in most of the time with less cost value. The mixed control produces almost the same control effect as the optimal injection timing control does; however, it entails the smallest insulin cost. FigureÂ 4(b) shows that the optimal injection dose control provides the least effective result at the cost of injecting the most insulin in the whole control process. Combining the optimal selection of injection timing with it results in much better performance in both the control effect of the plasma glucose and the cost value.
4.2 Optimal injection strategies for the second cost function
It is very complicated to consider the treatment for critically ill patients in Intensive Care Unit. Since their response to an insulin injection or a glucose input can vary significantly, both hyperglycemia and hypoglycemia may occur in a injection period. In this subsection, we study a different type of control objective function to prevent the occurrence of hypoglycemia. Assume that the glucose input rate \(G_{in}\) is slightly lower, that is, \(G_{in}=120\).
4.2.1 Optimal injection dose for periodic injection
First, we consider the optimization of injection dose for periodic injection, that is,
Starting with an initial injection dose \(\sigma _{d}=132\), if only simple impulsive releases are used but no optimal control is taken, then we obtain that after five periods, the cost value is \(\tilde{\mathcal{J}}_{2}= 327.8569 \) and the plasma glucose level at the terminal time is \(G(T)= [4] 51.581\text{ mg/dl}\).
Solving the corresponding optimal problem numerically in Matlab, we get that under the constraint \(0\leq \sigma _{d} \leq 200\), the optimal injection dose is \(\sigma ^{*}_{d}=99.164\) and the corresponding cost value is \(\tilde{\mathcal{J}}_{2}^{*}=323.9829\), whereas the plasma glucose level at the terminal time is \(G^{*}(T)=63.264\text{ mg/dl}\). We plot the time series diagrams of plasma glucose level for both this optimal control and simple impulsive control in Fig.Â 5(a). We find that the optimal injection dose control has obvious advantages in avoiding occurrence of hypoglycemia, as well as saving injection dose of insulin (see Fig.Â 5(a) and TableÂ 4).
We also investigate the influence of injection dose on the cost function and the glucose concentration at time T. FigureÂ 5(b) shows that when the injection dose varies within the interval \(0\leq \delta _{d} \leq 200\), the cost function \(\tilde{\mathcal{J}}_{2}(\delta _{d})\) admits a minimum point, which verifies the optimal results we obtained. FigureÂ 5(c) indicates that the plasma glucose level at the terminal time T decreases with an increase of the injection dose. The optimal control laws are depicted in Fig.Â 5(d).
4.2.2 Optimal injection timings with a fixed injection dose
We choose the same initial injection dose \(\sigma _{d}=132\) and select \(\tau _{1}=\tau _{2}=\tau _{3}=36\), \(\tau _{4}=48\), and \(\tau _{5}=84\) as the initial injection intervals. To determine the optimal time intervals \(\tau _{i}\) and optimal injection dose \(\sigma _{d}\) that minimize the cost function \(\bar{\mathcal{J}}_{2}\), we consider the following constraint conditions:
and \(0\leq \sigma _{d}\leq 200\).
Then solving this optimal problem in Matlab gives the following optimal injection intervals:
and optimal injection dose
Besides, we get the cost value \(\bar{\mathcal{J}}_{2}^{*}=308.0294\) and the plasma glucose level at the terminal time \(G^{*}(T)=78.219\text{ mg/dl}\).
We plot the time series diagrams of the plasma glucose level for the optimal injection timing control, optimal injection dose control, and simple impulsive control in Fig.Â 6(a). These three curves show that with a relatively low cost function value, the optimal injection timing control is the most robust in preventing hypoglycemia from occurring. For every \(\sigma _{d} \in [0,200]\), we determine the corresponding optimal time intervals under constraint (49) and then calculate the value of the cost function and the plasma glucose concentration at time \(T=240\). From Fig.Â 6(b) we find that when the injection dose varies within the interval \(0\leq \sigma _{d} \leq 200\) and the cost function \(\bar{\mathcal{J}}_{2}(\mathfrak{P}_{1}, \sigma _{d})\) admits a minimum point, which is consistent with the optimal result we have obtained. FigureÂ 6(c) shows a decrease of the plasma glucose level at the terminal time T with an increase of the injection dose. Our optimal timing control strategy expressed by (50) and (51) is shown in Fig.Â 6(d).
4.2.3 Optimal injection timing and injection dose
To deal with the optimal problem with constraints (44) and \(0\leq \delta _{i}\leq 200\), \(i=1,2,3,4\), we keep the same initial injection intervals \(\tau _{1}=\tau _{2}=\tau _{3}=36\), \(\tau _{4}=48\), \(\tau _{5}=84\) and choose the initial injection doses as \(\sigma _{1}=\sigma _{2}=\sigma _{3}=\sigma _{4}=132\). Solving this optimal problem numerically, we obtain the set of optimal injection doses
and the set of optimal injection intervals
This injection strategy is shown in Fig.Â 7(b). We obtain the minimum cost value \(\mathcal{J}_{2}^{*}=310.9245\) and the plasma glucose level at the terminal time \(G^{*}(T)=65.105\text{ mg/dl}\). The time series diagrams of the plasma glucose level under four types of control modes are plotted in Fig.Â 7(a). We find that compared with optimal dose control and optimal timing control, mixed optimal control provides better performance in avoiding occurrence of hyperglycemia.
TableÂ 5 and Fig.Â 8(a) give a comparison of these three optimal injection strategies. We find that the optimal injection timing control is superior to the optimal injection dose control in avoiding problems with hypoglycemia. Although the mixed control is the most effective in preventing hyperglycemia from occurring, it takes the largest consumption of insulin (see Fig.Â 8(b)).
5 Conclusion
In this paper, we formulated a novel switched impulsive dynamical system and used optimal control theory to study therapy protocols for diabetics with insulin pump in a limited time. Compared with model proposed in [20], our new model considers not only the endpoint control of plasma glucose level but also the fluctuations during the control process, which is in more accordance with the actual situation.
Taking into account both the fluctuations of plasma glucose level and the amount of insulin injected, we investigated three therapy strategies for two different objective functions. To solve technical problems in optimal impulsive control, we applied a time rescaling method and obtained gradient formulas of cost functions with respect to injection doses and injection timings. We numerically obtained optimal values of injection doses and timings for each therapy strategy. Numerical results indicate that for the objective function without considering the risk of hypoglycemia, the optimal injection timing control is superior to the optimal injection dose control, whereas the mixed control gets almost the same effect as the optimal injection timing control at a cost of less insulin injected. Numerical simulations also suggest that for the objective function considering the risk of hypoglycemia, the optimal injection timing control is superior to the optimal injection dose control in preventing hypoglycemia problems, and the mixed control is the best performing strategy in avoiding problems with hyperglycemia.
Availability of data and materials
Not applicable.
References
Bainov, D.D., Simeonov, P.S.: Impulsive Differential Equations: Periodic Solutions and Applications. Pitman Monographs and Surveys in Pure and Applied Mathematics. Pitman, London (1993)
Bainov, D.D., Simeonov, P.S.: System with Impulse Effect, Theory and Applications. Ellis Harwood Series in Mathematics and Its Applications. Ellis Harwood, Chichester (1993)
Bennett, D.L., Gourley, S.A.: Periodic oscillations in a model of the glucoseâ€“insulin interaction with delay and periodic forcing. Dyn. Syst. 19, 109â€“125 (2004)
Bennette, D.L., Gourley, S.A.: Asymptotic properties of a delay differential equation model for the interaction of glucose with the plasma and interstitial insulin. Appl. Math. Comput. 151, 189â€“207 (2004)
Bergman, R.N.: Pathogenesis and prediction of diabetes mellitus: Lessons from integrative physiology, Irving L. Schwartz Lecture. Mt. Sinai J. Med. 60, 280â€“290 (2002)
Bode, B.W.: Insulin pump use in type 2 diabetes. Diabetes Technol. Ther. 12(Suppl. 1), S17â€“S21 (2010)
Bolie, V.W.: Coefficients of normal blood glucose regulation. J. Appl. Physiol. 16, 783â€“788 (1961)
De Gaetano, A., Arino, O.: Mathematical modeling of the intravenous glucose tolerance test. J. Math. Biol. 40, 136â€“168 (2000)
Didangelos, T., Iliadis, F.: Insulin pump therapy in adults. Diabetes Res. Clin. Pract. 93S, S109â€“S113 (2011)
Fox, L.A., Buckloh, L.M., Smith, S.D., Wysocki, T., Mauras, N.: A randomized controlled trial of insulin pump therapy in young children with type 1 diabetes. Diabetes Care 28, 1277â€“1281 (2005)
Huang, M., Song, X.: Modeling and qualitative analysis of diabetes therapies with state feedback control. Int. J. Biomath. 7, 1450035 (2014)
Huang, M.Z., Li, J.X., Song, X.Y., Guo, H.J.: Modeling impulsive injections of insulin: towards artificial pancreas. SIAM J. Appl. Math. 72, 1524â€“1548 (2012)
Lee, K.T.H.W.J.: Control parametrization enhancing technique for time optimal control. Dyn. Syst. Appl. 6, 243â€“261 (1997)
Li, J., Kuang, Y.: Analysis of a glucoseâ€“insulin regulatory models with time delays. SIAM J. Appl. Math. 67(3), 757â€“776 (2007)
Li, J., Kuang, Y., Li, B.: Analysis of IVGTT glucoseâ€“insulin interaction models with time delay. Discrete Contin. Dyn. Syst., Ser. B 1, 103â€“124 (2001)
Li, J., Kuang, Y., Mason, C.: Modeling the glucoseâ€“insulin regulatory system and ultradian insulin secretory oscillations with two time delays. J. Theor. Biol. 242, 722â€“735 (2006)
Li, J., Wang, H., Palumbo, P., Panunzi, S., De Gaetano, A.: The range of time delay and the global stability of the equilibrium for an IVGTT model. Math. Biosci. (2011). https://doi.org/10.1016/j.mbs.2011.11.005
Liang, X.Y., Pei, Y.Z., Zhu, M.X., Lv, Y.F.: Multiple kinds of optimal impulse control strategies on plantpestpredator model with ecoepidemiology. Appl. Math. Comput. 287â€“288, 1â€“11 (2016)
Liu, S., Huang, M., Song, X., Shi, X.: Finitetime control of plasma glucose in insulin therapies for diabetes. Adv. Differ. Equ. 2018, 136 (2018)
Liu, Y., Teo, K.L., Jennings, L.S., Wang, S.: On a class of optimal control problems with state jumps. J. Optim. Theory Appl. 98(1), 65â€“82 (1998)
Maahs, D.M., Horton, L.A., Chase, H.P.: The use of insulin pumps in youth with type 1 diabetes. Diabetes Technol. Ther. 12(Suppl. 1), S59â€“S65 (2010)
Mukhopadhyay, A., De Gaetano, A., Arino, O.: Modeling the intravenous glucose tolerance test: a global study for a singledistributeddelay model. Discrete Contin. Dyn. Syst., Ser. B 4, 407â€“417 (2004)
Pei, Y.Z., Chen, M.M., Liang, X.Y., Li, C.G., Zhu, M.X.: Optimizing pulse timings and amounts of biological interventions for a pest regulation model. Nonlinear Anal. Hybrid Syst. 27, 353â€“365 (2018)
Raskin, P., Bode, B.W., Marks, J.B., Hirsch, I.B., Weinstein, R.L., McGill, J.B., Peterson, G.E., Mudaliar, S.R., Reinhardt, R.R.: Continuous subcutaneous insulin infusion and multiple daily injection therapy are equally effective in type 2 diabetes. Diabetes Care 26, 2598â€“2603 (2003)
Reznik, Y.: Continuous subcutaneous insulin infusion (CSII) using an external insulin pump for the treatment of type 2 diabetes. Diabetes Metab. 36, 415â€“421 (2010)
Roszler, J.: Senior pumpers: some seniors may benefit from pump therapy even more than young people do. Diabetes Forecast 55, 37â€“40 (2002)
Shi, X., Kuang, Y., Makroglou, A., Mokshagundam, S., Li, J.: Oscillatory dynamics of an intravenous glucose tolerance test model with delay interval. Chaos, Interdiscip. J. Nonlinear Sci. 27(11), 114324 (2017)
Song, X., Huang, M., Li, J.: Modeling impulsive insulin delivery in insulin pump with time delays. SIAM J. Appl. Math. 74, 1763â€“1785 (2014)
Steil, G.M., Hipszer, B., Reifman, J.: Mathematical modeling research to support the development of automated insulindelivery systems. J. Diabetes Sci. Technol. 3(2), 388â€“395 (2009)
Steil, G.M., Hipszer, B., Reifman, J.: Update on mathematical modeling research to support the development of automated insulindelivery systems. J. Diabetes Sci. Technol. 4(3), 759â€“769 (2010)
Sturis, J., Polonsky, K.S., Mosekilde, E., Van Cauter, E.: Computer model for mechanisms underlying ultradian oscillations of insulin and glucose. Am. J. Physiol. 260, E801â€“E809 (1991)
Teo, K.L.: Control parametrization enhancing transform to optimal control problems. Nonlinear Anal. TMA 63, e2223â€“e2236 (2005)
Tolic, I.M., Mosekilde, E., Sturis, J.: Modeling the insulinâ€“glucose feedback system: the significance of pulsatile insulin secretion. J. Theor. Biol. 207, 361â€“375 (2000)
Wang, H., Li, J., Kuang, Y.: Mathematical modeling and qualitative analysis of insulin therapies. Math. Biosci. 210, 17â€“33 (2007)
Wang, H., Li, J., Kuang, Y.: Enhanced modeling of the glucoseâ€“insulin system and its applications in insulin therapies. J. Biol. Dyn. 3, 22â€“38 (2009)
Acknowledgements
The authors are very grateful to the editor and the anonymous referees for their valuable comments and constructive suggestions, which helped us to significantly improve the paper.
Funding
This work is supported by the National Natural Science Foundation of China (11901502, 11701495, and 11871415), Training program for Young Core Instructors in Henan Province (2019GGJS157), Foundation of Henan Educational Committee under Contract (21A110022), Program for Science & Technology Innovation Talents in Universities of Henan Province (21HASTIT026), Nanhu Scholars Program for Young Scholars of XYNU.
Author information
Authors and Affiliations
Contributions
All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Consent for publication
Not applicable.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the articleâ€™s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the articleâ€™s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Liu, S., Yu, L., Huang, M. et al. Optimal selection of injection doses and injection timings for insulin therapy in a limited time. Adv Differ Equ 2020, 653 (2020). https://doi.org/10.1186/s1366202003111z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s1366202003111z