Definition
Residual
The residual of a prediction is the signed gap between the predicted value
and the observed target : A residual is zero for a correct prediction, positive when the model underpredicts (
), and negative when it overpredicts ( ). It measures the error on a single observation and is the quantity that loss functions such as quadratic loss and aggregates such as the mean squared error operate on.