African Journal of
Mathematics and Computer Science Research

  • Abbreviation: Afr. J. Math. Comput. Sci. Res.
  • Language: English
  • ISSN: 2006-9731
  • DOI: 10.5897/AJMCSR
  • Start Year: 2008
  • Published Articles: 245

Full Length Research Paper

A theoretical and experimental study of the Broyden-Fletcher-Goldfarb-Shano (BFGS) update

T. A. Adewale
  • T. A. Adewale
  • Department of Industrial Mathematics, Adekunle Ajasin University, P. M. B. 1, Akungba – Akoko, Nigeria
  • Google Scholar
B. I. Oruh
  • B. I. Oruh
  • Department of Mathematics/Statistics/Computer Science, Michael Okpara University of Agriculture, Umudike, Nigeria
  • Google Scholar


  •  Accepted: 10 May 2013
  •  Published: 31 August 2013

Abstract

 

This paper discusses theoretically the evolution of a conjugate direction algorithm for minimizing an arbitrary nonlinear, non quadratic function using Broyden-Fletcher-Goldfarb-Shano (BFGS) update in quasi-Newton Method. The updating rule is initialized by a Moore Penrose’s generalized inverse. Specifically, an approximation to the inverse Hessian is constructed and the updating rule for this approximation is imbedded in the BFGS update. Numerical experiments show that, using the proposed line search algorithm and the modified quasi-Newton algorithm for unconstrained problems are very competitive. This paper produces a new analysis that demonstrates that the BFGS method with a line search is  step q-superlinear convergent with assumption of linearly independent iterates. The analysis assumes that the inverse Hessian approximations are positive definite and bounded asymptotically, which from computational experience, are of reasonable assumptions.

 

Key words: Quasi-Newton method, Moore-Penrose generalized inverse, Broyden-Fletcher-Goldfarb-Shano (BFGS) update, superlinear convergence, conjugate directions, orthogonalization of matrices.