# What is Embedding? Bridge from Token ID to Meaning Vector — The Discrete-to-Continuous Revolution

> Source: https://sukruyusufkaya.com/en/learn/llm-muhendisligi/embedding-nedir-token-id-vektor-koprusu
> Updated: 2026-05-13T13:00:26.928Z
> Category: LLM Mühendisliği
> Module: Module 7: Embedding Layer — The Vector Space of Meaning
**TLDR:** Mathematical anatomy of embedding: integer token ID to d-dimensional dense vector mapping. Vocab × d_model matrix. Degenerate case of one-hot encoding. Why semantic vector space works (distributional hypothesis, Firth 1957). 'Meaning emerges from co-occurrence' philosophy. Pre-NN era (LSA, LSI) vs neural era (word2vec → BERT → LLM). Practical meaning for Turkish.