# Decoder-Only Transformer

> Source: https://sukruyusufkaya.com/en/glossary/decoder-only-transformer
> Updated: 2026-05-13T20:00:15.054Z
> Type: glossary
> Category: derin-ogrenme
**TLDR:** A modern large-language-model architecture that generates autoregressively by predicting the next token.

<p>The decoder-only Transformer forms the basis of most modern large language models. It generates autoregressively by predicting the next token based on prior context. This creates a strong alignment between a simple training objective and large-scale pretraining. It has become the dominant architecture in text generation, code generation, and general-purpose language modeling.</p>