# The Mathematics of In-Context Learning: Implicit Bayesian Inference and Induction Heads

> Source: https://sukruyusufkaya.com/en/learn/llm-muhendisligi/in-context-learning-matematik-induction-heads
> Updated: 2026-05-13T13:00:24.900Z
> Category: LLM Mühendisliği
> Module: Module 4: The Mental Model of LLMs
**TLDR:** Mathematical explanations of GPT-3's few-shot learning: implicit Bayesian inference (Xie 2022), induction heads mechanism (Olsson 2022), task identification and learning algorithm emergence. Why prompting with examples works, why only in sufficiently large models, why it fails OOD.