Derivative

The derivative is a core concept that shows how a function responds to a small change. In other words, it measures slope and rate of change at a given point. In machine learning, derivative information is used to understand how the loss function changes with respect to model parameters. Without it, most optimization methods would not work. Although it may appear abstract, the derivative is one of the engines of modern model training.