# BFGS

> Source: https://sukruyusufkaya.com/en/glossary/bfgs
> Updated: 2026-05-13T20:02:21.939Z
> Type: glossary
> Category: matematik-istatistik-optimizasyon
**TLDR:** A quasi-Newton optimization method that approximates second-order information to achieve efficient convergence.

<p>BFGS is a quasi-Newton optimization algorithm that tries to preserve the strength of Newton’s method while reducing the cost of Hessian computation. Instead of computing exact second-order information, it uses clever approximations to accelerate optimization. This makes it highly effective for many smooth, medium-scale problems. It performs well in statistical estimation, engineering optimization, and some classical machine learning problems. BFGS is a successful example of the principle: if exact second-order information is too expensive, use a strong approximation.</p>