# Masked Language Modeling

> Source: https://sukruyusufkaya.com/en/glossary/masked-language-modeling
> Updated: 2026-05-13T20:59:37.328Z
> Type: glossary
> Category: derin-ogrenme
**TLDR:** A pretraining objective based on masking some input tokens and predicting them from context.

<p>Masked Language Modeling plays a central role in the pretraining of encoder-based language models. The model learns to predict hidden tokens from the surrounding context. This supports not just generation, but deeper contextual understanding. It is a powerful and historically influential pretraining paradigm in modern representation learning.</p>