In this article, we construct a family of iterative methods for finding a single root of nonlinear equation and then generalize this family of iterative methods for determining all roots of nonlinear equations simultaneously. Further we extend this family of root estimating methods for solving a system of nonlinear equations. Convergence analysis shows that the order of convergence is 3 in case of the single root finding method as well as for the system of nonlinear equations and is 5 for simultaneous determination of all distinct and multiple roots of a nonlinear equation. The computational cost, basin of attraction, efficiency, log of residual and numerical test examples show that the newly constructed methods are more efficient as compared to the existing methods in literature.
1 Introduction
To solve the nonlinear equation
$$ f(x)=0 $$
(1)
is the oldest problem of science in general and in mathematics in particular. These nonlinear equations have diverse applications in many areas of science and engineering. In general, to find the roots of (1), we look towards iterative schemes, which can be further classified as to approximate a single root and all roots of (1). There exists another class of iterative methods in literature which solves nonlinear systems. In this article, we are going to work on all these three types of iterative methods. A lot of iterative methods for finding roots of nonlinear equations and their system of different convergence order already exist in the literature (see [1–12]). The aforementioned methods are used to approximate one root at a time. But mathematician are also interested in finding all roots of (1) simultaneously. This is due to the fact that simultaneous iterative methods are very popular due to their wider region of convergence, are more stable as compared to single root finding methods, and implemented for parallel computing as well. More details on simultaneous determination of all roots can be found in [13–25] and the references cited therein.
The main aim of this paper to construct a family of optimal third order iterative methods and then convert them into simultaneous iterative methods for finding all distinct as well as multiple roots of nonlinear equation (1). We further extend this family of iterative methods for solving a system of nonlinear equations. Basins of attractions of single roots finding methods are also given to show the convergence behavior of iterative methods.
2 Constructions of a family of methods for single root and convergence analysis
Here, we present some well-known existing methods of third order iterative methods.
Singh et al. [4] presented the following optimal third order method (abbreviated as E1):
where \(\alpha \in \mathbb{R} \). For iteration schemes (2), we have the following convergence theorem by using CAS Maple 18 and the error relation of the iterative schemes defined in (2).
Theorem 1
Let\(\zeta \in I\)be a simple root of a sufficiently differential function\(f:I\subseteq R\longrightarrow R\)in an open interval I. If\(x_{0}\)is sufficiently close toζ, then the convergence order of the family of iterative methods (2) is three and the error equation is given by
Let ζ be a simple root of f and \(x^{(k)}=\zeta +e^{(k)}\). By Taylor’s series expansion of \(f(x^{(k)})\) around \(x^{(k)}=\zeta \), taking \(f(\zeta )=0\), we get
where \(N(x_{i})=\frac{f(x_{i}^{(k)})}{f^{\prime }(x_{i}^{(k)})}\) and \(i,j=1,2,3,\ldots,n\). Now from (13), an approximation of \(\frac{f(x_{i}^{(k)})}{f^{\prime }(x_{i}^{(k)})}\) is formed by replacing \(x_{j}^{(k)}\) with \(z_{j}^{(k)}\) as follows:
where \(z_{j}^{(k)}=y_{j}^{(k)}- ( \frac{f^{\prime }(x_{j}^{(k)})-f^{\prime }(y_{j}^{(k)})}{\alpha f^{\prime }(y_{j}^{(k)})+(2-\alpha )f^{\prime }(x_{j}^{(k)})} ) ( \frac{f(x_{j}^{(k)})}{f^{\prime }(x_{j}^{(k)})} ) \) and \(y_{j}^{(k)}=x_{j}^{(k)}- ( \frac{f(x_{j}^{(k)})}{f^{\prime }(x_{j}^{(k)})} ) \). Thus, we get the following new family of simultaneous iterative methods for extracting all distinct as well as multiple roots of nonlinear equation (1) abbreviated as SM1. Zhang et al. [30] presented the following fifth order simultaneous methods:
In this section, the convergence analysis of a family of simultaneous methods (17) is given in a form of the following theorem. Obviously, convergence for method (17) will follow from the convergence of method (SM1) from theorem (2) when the multiplicities of the roots are simple.
Theorem 2
(2)
Let\(\zeta _{{1}},\ldots,\zeta _{n}\)be the n number of simple roots with multiplicities\(\sigma _{{1}},\ldots,\sigma _{n}\)of nonlinear equation (1). If\(x_{1}^{(0)},\ldots,x_{n}^{(0)}\)is the initial approximations of the roots respectively and sufficiently close to actual roots, the order of convergence of method (SM1) equals five.
where \(z_{j}^{(k)}-\zeta _{j}=\epsilon _{j}^{3}\) from (3) and \(E_{i}= ( \frac{-\sigma _{j}}{(x_{i}^{(k)}-\zeta _{j})(x_{i}^{(k)}-z_{j}^{(k)})} ) \).
If it is assumed that absolute values of all errors \(\epsilon _{j}\) (\(j=1,2,3,\ldots\)) are of the same order as, say \(\vert \epsilon _{j} \vert =O \vert \epsilon \vert \), then from (29) we have
In this work, we consider the following system of nonlinear equations:
$$ \mathbf{F(x)=}0, $$
(31)
where in \(\mathbf{F(x)}=(f_{1}(x),f_{2}(x),\ldots,f_{n}(x))^{T}\) and the functions \(f_{1}(x),f_{2}(x),\ldots,f_{n}(x)\) are the coordinate functions of [31].
There are many approaches to solving nonlinear system (31). One of the famous iterative methods is Newton–Raphson method for solving the system of nonlinear equations
where \(\alpha \in \mathbb{R} \). We abbreviate this family of iterative methods for approximating roots of the system of nonlinear equations by QQ1.
Theorem 3
Let the function\(\mathbf{F}:E\subseteq \mathbb{R} ^{n}\rightarrow \mathbb{R} ^{n}\)be sufficiently Fréchet differentiable on an open setEcontaining the rootζof\(\mathbf{F}(\mathbf{x}^{(k)}\mathbf{)}=0\). If the initial estimation\(\mathbf{x}^{(0)}\)is close toζ, then the convergence order of the method QQ1 is at least three, provided that\(\alpha \in \mathbb{R} \).
Proof
Let \(\mathbf{e}^{(k)}=\mathbf{x}^{(k)}-\boldsymbol{\zeta}\), , and \(\widehat{\mathbf{e}}^{(k)}=\mathbf{z}^{(k)}-\boldsymbol{\zeta}\) be the errors in developing Taylor series of \(\mathbf{F(x}^{(k)})\) in the neighborhood of ζ assuming that \(\mathbf{F}^{\prime }(\mathbf{r)}^{-1}\) exists, we write
5 Complex dynamical study of families of iterative methods
Here, we discuss the dynamical study of iterative methods (Q1, E1–E6). We investigate the region from where we take the initial estimates to achieve the roots of nonlinear equation. Actually, we numerically approximate the domain of attractions of the roots as a qualitative measure, how the iterative methods depend on the choice of initial estimations. To answer these questions on the dynamical behavior of the iterative methods, we investigate the dynamics of method Q1 and compare it with E1–E6. For more details on the dynamical behavior of the iterative methods, one can consult [3, 35, 36]. Taking a rational function \(\Re _{f}:\mathbb{C} \longrightarrow \mathbb{C} \), where \(\mathbb{C} \) denotes the complex plane, the orbit \(x_{0}\in \mathbb{C} \) defines a set such as \(\operatorname{orb}(x)=\{x_{0},\Re _{f}(x_{0}),\Re _{f}^{2}(x_{0}),\ldots,\Re _{f}^{m}(x_{0}),\ldots \}\). The convergence \(\operatorname{orb}(x)\rightarrow x^{\ast }\) is understood in the sense if \(\underset{x\rightarrow \infty }{\lim }R^{k}(x)=x^{\ast }\) exists. A point \(x_{0}\in \mathbb{C} \) is known as attracting if \(\vert R^{k^{\prime }}(x) \vert <1\). An attracting point \(x_{0}\in \mathbb{C} \) defines the basin of attraction as the set of starting points whose orbit tends to \(x^{\ast }\). For the dynamical and graphically point of view, we take \(2000\times 2000\) grid of square \([-2.5,2.5]^{2}\in \mathbb{C} \). To each root of (1), we assign a color to which the corresponding orbit of the iterative method starts and converges to a fixed point. Take color map as Jet and Hot respectively. We use \(\vert x_{i+1}\text{-}x_{i} \vert <10^{-3}\) and \(\vert f(x_{i}) \vert <10^{-3}\) as stopping criteria, and the maximum number of iterations is taken as 20. We mark a dark blue point when using stopping criteria \(\vert x_{i+1}\text{-}x_{i} \vert <10^{-3}\) and dark black point when using \(\vert f(x_{i}) \vert <10^{-3}\). Different color is used for different roots. Iterative methods have different basins of attraction distinguished by their colors. We obtain basins of attractions for the following three test functions \(f_{1}(x)=x^{4}-ix^{2}+1\), \(f_{2}(x)=(1+2i)x^{5}+1-2i\), and \(f_{3}(x)=x^{6}-ix^{3}+1\). The exact roots of \(f_{1}(x)\), \(f_{2}(x)\), and \(f_{3}(x)\) are given in Table 1. Brightness in color means a lower number of iterations steps.
Table 1 Exact roots of functions \(f_{1}(x)\), \(f_{2}(x)\), and \(f_{3}(x)\)
Here, some numerical examples are considered in order to demonstrate the performance of our family of one-step third order single root finding methods (Q1), fifth order simultaneous methods (SM1), and third order family of iterative methods for solving the nonlinear system of equations respectively. We compared our family of single root finding methods (Q1) with third order iterative methods (E1–E6). The family of simultaneous methods (SM1) of order five is compared with Zhang et al. method [30] of the same order (abbreviated as ZPH method). Iterative methods for finding roots of nonlinear system (QQ1) are compared with EE1–EE3 respectively. All the computations are performed using CAS Maple 18 with 2500 (64 digits floating point arithmetic in case of simultaneous methods) significant digits with stopping criteria as follows:
where \(e_{i}\) and \(\mathbf{e}^{(k)} \) represent the absolute error. We take \(\in =10^{-600}\) for the single root finding method, \(\in =10^{-30}\) for simultaneous determination of all roots of nonlinear equation (1), and \(\in =10^{-15}\) for approximating roots of nonlinear system (31).
Numerical test examples from [32, 34, 37, 38] are provided in Tables 2–8. In Table 3 stopping criterion (i) is used, in Table 2 stopping criteria (i) and (ii) both are used, while in Tables 4–8 stopping criteria (iii) and (iv) both are used. In all Tables CO represents the convergence order, n represents the number of iterations, ρ represents local computational order of convergence [39], and CPU represents computational time in seconds. We observe that numerical results of the family of iterative methods (in case of single Q1) as well as simultaneous determination (SM1 of all roots) and for approximating roots of system of nonlinear equations QQ1 are better than E1–E6, ZPH, and EE1–EE3 respectively on the same number of iterations. Figures 4(a)–(b)–6(a), (b) represent the residual fall for the iterative methods (Q1, SM1, QQ1, ZPH, E1–E6, EE1–EE3). Figures 4(a) and 4(b) show residual fall for single (Q1, E1–E6) and simultaneous determination of all roots (SM1, ZPH), while Figs. 5(a), (b) and 6(a), (b) show residual fall for (QQ1, EE1–EE3) respectively. Tables 2–8 and Figs. 1–6 clearly show the dominance convergence behavior of our family of iterative methods (Q1, SM1, QQ1) over E1–E6, ZPH, and EE1–EE3.
Figure 1
Figure 1(a), (e), (g), (i), (k), (m), (o) shows basins of attraction of iterative methods Q1, E1–E6 for the nonlinear function \(f_{1}(x)=x^{4}-ix^{2}+1\) using \(\vert x^{(k+1)}\text{-}x^{(k)} \vert <10^{-3}\). Figure 1(b), (f), (h), (j), (l), (n), (p) shows basins of attraction of iterative methods Q1, E1–E6 using \(\vert f(x^{(k)}) \vert <10^{-3}\). Figure 1(c), (d) shows the basin of attraction for \(\alpha =-0.000001\). In Fig. 1(a)–(p), brightness of color in basins of Q1 shows a lower number of iterations for convergence of iterative methods as compared to methods E1–E6.
Figure 2(a), (e), (g), (i), (k), (m), (o) shows basins of attraction of iterative methods Q1, E–E6 for the nonlinear equation \(f_{2}(x)=(1+2i)x^{5}+1-2i\) using \(\vert x^{(k+1)}\text{-}x^{(k)} \vert <10^{-3}\). Figure 2(b), (f), (h), (j), (l), (n), (p) shows basins of attraction of iterative methods Q1, E1–E6 using \(\vert f(x^{(k)}) \vert <10^{-3}\). Figure 2(c), (d) shows the basin of attraction for \(\alpha =-0.000001\). In Fig. 2(a)–(p), brightness of color in basins of Q1 shows a lower number of iterations for convergence of iterative method as compared to methods E1–E6.
Figure 3(a), (e), (g), (i), (k), (m), (o) shows basins of attraction of iterative methods Q1, E1–E6 for the nonlinear equation \(f_{3}(x)=x^{6}-ix^{3}+1\) using \(\vert x^{(k+1)}\text{-}x^{(k)} \vert <10^{-3}\). Figure 3(b), (f), (h), (j), (l), (n), (p) shows basins of attraction of iterative methods Q1, E1–E6 using \(\vert f(x^{(k)}) \vert <10^{-3}\). Figure 3(c), (d) shows the basin of attraction for \(\alpha =-0.000001\). In Fig. 3(a)–(p), brightness of color in basins of Q1 shows a lower number of iterations for convergence of iterative method as compared to methods E1–E6.
Figures 4(a)–(b), 4(a) show residual graph of single roots finding method Q1, E1–E6 and 4(b) for simultaneous determination of all roots of \(f_{4}(x)\) using ZPH and SM1 respectively.
The exact roots of (42) are \(\zeta _{1}=2.0021\), \(\zeta _{2}=-3.3304 \), \(\zeta _{3}=-1.5417\).
The initial estimates for \(f_{4}(x)\) are taken as: \(\overset{ (0)}{x_{1}} =2.5\), \(\overset{ (0)}{x_{2}} =-7.4641\), \(\overset{ (0)}{x_{3}}=-0.5359\).
the exact solution of this system is \(\mathbf{X}^{\ast }=[0,0,0,\ldots,0]^{T}\), and we take \(\mathbf{X}_{0}=[0.5,0.5,0.5,\ldots, 0.5]^{T}\) as initial estimates. Table shows the results of this system of nonlinear equations.
Example 5
(N-dimensional problem)
Consider the following system of nonlinear equations:
the exact solution of this system is \(\mathbf{X}^{\ast }=[1,1,1,\ldots,1]^{T}\), and we take \(\mathbf{X}_{0}=[2,2,2,\ldots,2]^{T}\) as initial estimates. Table shows the results of this system of nonlinear equations.
Using the procedure of finite difference method, we solve this nonlinear BVP. By taking \(h=0.1\), we discretize the interval \([1,3]\) into \(N+1=19+1=20\) equal subintervals (see Table 7). As \(x_{i}=a+h\) gives values of \(x_{i}\), where \(a=1\).
We use the central difference formula for both \(y^{\prime \prime }(x_{i})\) and \(y^{\prime }(x_{i})\) derived in Burden and Faires in [40] as follows:
We have developed here families of single root finding methods of convergence order three for a nonlinear equation as well as for a system of nonlinear equations and families of simultaneous methods of order five respectively. From Tables 2–8 and Figs. 1–5 and 6, we observe that our methods (Q1, SM1, and QQ1) are superior in terms of efficiency, stability, CPU time, and residual error as compared to the methods E1–E6, ZPH, and EE1–EE3 respectively.
Figure 5
Figure 5(a)–(b) shows a residual graph of iterative methods QQ1, EE1–EE3 for solving \(\mathbf{F}_{1}(\mathbf{X})\) and \(\mathbf{F}_{2}(\mathbf{X})\) respectively.
Figure 6(a)–(b) shows a residual graph of iterative methods QQ1, EE1–EE3 for solving \(\mathbf{F}_{3}(\mathbf{X})\) and \(\mathbf{F}_{4}(\mathbf{X})\) respectively.
Chicharro, F., Cordero, A., Torregrosa, J.R.: Drawing dynamical and parameters planes of iterative families and methods. Sci. World J. 2013, Article ID 780153 (2013)
Babajee, D.K.R., Cordero, A., Soleymani, F., Torregrosa, J.R.: On improved three-step schemes with high efficiency index and their dynamics. Numer. Algorithms 65, 153–169 (2014)
Singh, A., Jaiswal, J.P.: Several new third-order and fourth-order iterative methods for solving nonlinear equations. Int. J. Eng. Math. 2014, Article ID 828409 (2014)
Khan, M.S., Berzig, M., Samet, B.: Some convergence results for iterative sequences of Prešić type and applications. Adv. Differ. Equ. 2012, 38 (2012). https://doi.org/10.1186/1687-1847-2012-38
Kanno, S., Kjurkchiev, N., Yamamoto, T.: On some methods for the simultaneous determination of polynomial zeros. Jpn. J. Ind. Appl. Math. 13, 267–288 (1995)
Proinov, P.D.: General convergence theorems for iterative processes and applications to the Weierstrass root-finding method. J. Complex. 33, 118–144 (2016)
Mir, N.A., Muneer, R., Jabeen, I.: Some families of two-step simultaneous methods for determining zeros of non-linear equations. ISRN Appl. Math. 2011, Article ID 817174 (2011)
Nourein, A.W.: An improvement on two iteration methods for simultaneously determination of the zeros of a polynomial. Int. J. Comput. Math. 6, 241–252 (1977)
Proinov, P.D., Vasileva, M.T.: On the convergence of higher-order Ehrlich-type iterative methods for approximating all zeros of polynomial simultaneously. J. Inequal. Appl. 2015, 336 (2015)
Nedzhibov, G.H.: Iterative methods for simultaneous computing arbitrary number of multiple zeros of nonlinear equations. Int. J. Comput. Math. 90(5), 994–1007 (2013)
Farmer, M.R.: Computing the zeros of polynomials using the divide and conquer approach. Ph.D Thesis, Department of Computer Science and Information Systems, Birkbeck, University of London (2014)
Proinov, P.D., Vasileva, M.T.: On the convergence of high-order Gargantini–Farmer–Loizou type iterative methods for simultaneous approximation of polynomial zeros. Appl. Math. Comput. 361, 202–214 (2019)
Zhang, X., Peng, H., Hu, G.: A high order iteration formula for the simultaneous inclusion of polynomial zeros. Appl. Math. Comput. 179, 545–552 (2006)
The authors declare that they have no competing interests.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
Shams, M., Rafiq, N., Kausar, N. et al. On iterative techniques for estimating all roots of nonlinear equation and its system with application in differential equation.
Adv Differ Equ2021, 480 (2021). https://doi.org/10.1186/s13662-021-03636-x