Query-Key-Value Representation

The query-key-value separation is a fundamental representational idea explaining why attention mechanisms are so powerful and flexible. The query expresses what is being sought, the key indicates what may match, and the value determines what content is actually transferred. This separation turns attention from a simple similarity score into a more general information-access system. It is the conceptual core of modern Transformer design.