Stacking

Stacking is an advanced ensemble approach that attempts to combine the strengths of different model families within one system. Predictions from base models are learned by a second-level meta-model. This can improve performance when different models exhibit different error patterns. However, the training procedure must be designed carefully to avoid data leakage.