
TailLoR: Protecting Principal Components in Parameter-Efficient Continual Learning
TailLoR addresses a core tension in continual learning: how to adapt pre-trained models to new tasks without catastrophic forgetting of earlier knowledge. By anchoring low-rank updates to the spectral structure of original weights and penalizing changes along dominant singular directions, the method routes learning into underutilized parameter space. This matters because parameter-efficient finetuning is becoming standard practice for scaling foundation models across domains, and techniques that preserve learned representations while enabling task-specific adaptation directly impact how practitioners deploy large models in multi-task pipelines.58





















