Glossary Library

Technical GlossaryGenerative AI and LLM

Mixture of Experts

An approach in which only relevant expert subnetworks are activated for each input to achieve scale and efficiency.

Mixture of Experts makes it possible to scale to very large model capacity without using every parameter at every step. This architecture can keep active parameter usage low while maintaining high total knowledge capacity. However, routing stability, expert balance, and training complexity are central challenges of the approach.

You Might Also Like

Explore these concepts to continue your artificial intelligence journey.

Glossary Cover

yapay-zeka-temelleri

Generative AI

A class of AI systems capable of generating new content such as text, images, audio, video, or code.

Glossary Cover

veri-bilimi-ve-veri-yonetimi

Feature Hashing

A method that maps features into a fixed-dimensional space using hash functions to provide scalable representation.

Glossary Cover

veri-bilimi-ve-veri-yonetimi

Programmatic Labeling

An approach in which labels are generated automatically through code, rules, or functions rather than manual entry.