Global Convergence of Nonlinear Conjugate Gradient Coefficients with Inexact Line Search

(Awad Abdelrahman , Osman O. O. Yousif , Mogtaba Mhammed and Murtada K. Elbashir)

---

Abstract

Nonlinear conjugate gradient (CG) methods are significant for solving large-scale, unconstrained optimization problems, providing vital knowledge to determine the minimum point or optimize the objective functions. Many studies of modifications for nonlinear CG methods have been carried out to improve the performance of numerical computation and to establish global convergence properties. One of these studies is the modified CG method, which has been proposed by Rivaie et al. (2015). In this paper, we modify their work in such a way that one can obtain efficient numerical performance and global convergence properties. Due to the widespread use of the strong Wolfe line search in practice, our proposed modified method implemented its use. At the same time, to show the performance of the modified method in practice, a numerical experiment is performed.


KEYWORDS
Unconstrained optimization; conjugate gradient method; sufficient descent property; global convergence

PDF

References

Al-Baali, M. (1985). Descent property and global convergence of the Fletcher-Reeves method with inexact line search. IMA Journal of Numerical Analysis, 5(1), 121–4.
Andrei, N. (2008). An unconstrained optimization test functions collection. Adv. Model. Optim, 10(1), 147–61. 
Andrei, N. (2011). Open problems in nonlinear conjugate gradient algorithms for unconstrained optimization. Bulletin of the Malaysian Mathematical Sciences Society, 34(2), 19–330.
Dai, Y.H. and Yuan, Y. (1999). A nonlinear conjugate gradient method with a strong global convergence property. SIAM Journal on Optimization, 10(1), 177–82.
Dai, Z. (2016). Comments on a new class of nonlinear conjugate gradient coefficients with global convergence properties. Applied Mathematics and Computation, 276(n/a), 297–300.
Dolan, E.D. and Moré, J.J. (2002). Benchmarking optimization software with performance profiles. Mathematical Programming, 91(2), 201–13.
Gilbert, J.C. and Nocedal, J. (1992). Global convergence properties of conjugate gradient methods for optimization. SIAM Journal on Optimization, 2(1), 21–42.
Guanghui, L., Jiye, H. and Hongxia, Y. (1995). Global convergence of the Fletcher-Reeves algorithm with inexact linesearch. Applied Mathematics-A Journal of Chinese Universities, 10(1), 75–82.
Fletcher, R. (1987). Practical Method of Optimization, Unconstrained Optimization. New York: John Wiley and Sons.
Fletcher, R. and Reeves, C.M. (1964). Function minimization by conjugate gradients. The computer journal, 7(2), 149–54.
Hestenes, M.R. and Stiefel, E. (1952). Methods of conjugate gradients for solving linear systems. J. Res. Nat. Bur. Standards, 49(6), 409–35.
Jiang, X. and Jian, J. (2019). Improved Fletcher–Reeves and Dai–Yuan conjugate gradient methods with the strong Wolfe line search. Journal of Computational and Applied Mathematics, 348(n/a), 525–34.
Liu, Y. and Storey, C. (1991). Efficient generalized conjugate gradient algorithms, part 1: Theory. Journal of Optimization Theory and Applications, 69(1), 129–37.
Rivaie, M., Mamat, M. and Abashar, A. (2015). A new class of nonlinear conjugate gradient coefficients with exact and inexact line searches. Applied Mathematics and Computation, 268(n/a), 1152–63.
Rivaie, M., Mamat, M., June, L. W. and Mohd, I. (2012). A new class of nonlinear conjugate gradient coefficients with global convergence properties. Applied Mathematics and Computation, 218(22), 11323–32.
Polak, E. and Ribiere, G. (1969). Note on the convergence of conjugate direction methods. Mathematical Modeling and Numerical Analysis, 3(1), 35–43.
Powell, M.J. (1984). Nonconvex minimization calculations and the conjugate gradient method. In: M.J Powell (ed.) Numerical Analysis. Berlin, Germany: Springer.
Touati-Ahmed, D. and Storey, C. (1990). Efficient hybrid conjugate gradient techniques. Journal of Optimization Theory and Applications, 64(2), 379–97.
Yousif, O.O.O. (2020). The convergence properties of RMIL+ conjugate gradient method under the strong Wolfe line 
     search. Applied Mathematics and Computation, 367(1), 124777.
Zoutendijk, G. (1970). Nonlinear programming, computational methods. In: J. Abadie (ed.) Integer and Nnonlinear Programming. Amsterdam, Switzerland: North-Holland.