# Gradient Checking

> Source: https://sukruyusufkaya.com/en/glossary/gradient-checking
> Updated: 2026-05-13T19:58:40.958Z
> Type: glossary
> Category: derin-ogrenme
**TLDR:** A debugging technique that validates analytical gradients by comparing them with numerical approximations.

<p>Gradient checking is a critical validation tool, especially in custom layers or systems where derivatives are implemented manually. Numerical derivatives are estimated through small perturbations and compared against the analytical gradients produced by backpropagation. This helps catch silent derivative bugs early. It is important not only for training performance but also for correctness assurance.</p>