Skip to content
Technical GlossaryGenerative AI and LLM

Catastrophic Forgetting

The problem in which a model loses some of its prior general abilities while being adapted to new tasks.

Catastrophic forgetting can arise when the new task becomes overly dominant during fine-tuning. The model may improve in one domain while weakening its general versatility or prior knowledge structure. This requires careful data balancing, regularization, and evaluation strategies.