# Capstone Module 8: Alternatives to Quadratic Attention — Linear Attention, RetNet, Mamba (State Space Models)

> Source: https://sukruyusufkaya.com/en/learn/llm-muhendisligi/capstone-linear-attention-retnet-mamba-ssm
> Updated: 2026-05-13T13:00:27.826Z
> Category: LLM Mühendisliği
> Module: Module 8: Attention Mathematics — The Heart of Transformer
**TLDR:** Module 8 capstone: alternatives to quadratic attention. Linear Attention (Katharopoulos 2020) — kernel trick + recurrent form. RetNet (Sun 2023) — retention mechanism Microsoft. Mamba (Gu Dao 2023) — selective state space models. Which sub-quadratic architecture for which scenario, GPT-4 vs Mamba comparison, hybrid models (Jamba), future trends.