Technical GlossaryGenerative AI and LLM
Catastrophic Forgetting
The problem in which a model loses some of its prior general abilities while being adapted to new tasks.
Catastrophic forgetting can arise when the new task becomes overly dominant during fine-tuning. The model may improve in one domain while weakening its general versatility or prior knowledge structure. This requires careful data balancing, regularization, and evaluation strategies.
You Might Also Like
Explore these concepts to continue your artificial intelligence journey.
