Continual Learning and Catastrophic Forgetting

arxiv:2403.05175

Original source · Paper JSON

Data, training, optimization · 2024-03-08

Cites (2) · Cited by (0)

Complete cleaned Markdown · Source Markdown including bibliography

Read in parts

1. Part 1
2. Part 2
3. Part 3
4. Part 4
5. Part 5

Contents

• Continual Learning and Catastrophic Forgetting
• Abstract
• Key Points
• 1 Introduction
• 2 The Continual Learning Problem
• 2.1 Catastrophic Forgetting
• 2.2 Other Features Important for Continual Learning
• 2.3 Task-based versus Task-free Continual Learning
• 2.4 Three Continual Learning Scenarios
• Clarifying note.
• 2.5 Evaluation
• 3 Continual Learning Approaches
• 3.1 Replay
• 3.2 Parameter Regularization
• 3.3 Functional Regularization
• 3.4 Optimization-based Approaches
• 3.5 Context-dependent Processing
• 3.6 Template-based Classification
• 4 Continual Learning in Deep Learning versus in Cognitive Science
• 5 Conclusion
• Acknowledgements