The Stability-Plasticity Dilemma: How Memory Architectures Are Solving Continual Learning
A comparative analysis of approaches to catastrophic forgetting in language models, from parameter regularization to sparse memory architectures that reduce forgetting from 89% to just 11%.
