Encoder-Decoder Transformer

The encoder-decoder Transformer is the classical architecture designed for translation, summarization, and sequence-to-sequence tasks. The encoder produces input representations, while the decoder generates the output sequence using those representations. Through cross-attention, output generation can be directly aligned with input context. This architecture forms an important historical foundation for modern generative language systems.