# Stochastic Weight Averaging

> Source: https://sukruyusufkaya.com/en/glossary/stochastic-weight-averaging
> Updated: 2026-05-13T20:57:38.979Z
> Type: glossary
> Category: derin-ogrenme
**TLDR:** A method that averages parameter states from different stages of training in order to obtain more robust generalization.

<p>Stochastic Weight Averaging aims to produce more balanced solutions by averaging parameter states encountered late in training. The method is based on the idea of converging toward broader and more stable solution regions instead of a single sharp point. It can often improve generalization without major additional cost. It can be especially effective when considered together with the choice of optimizer.</p>