Learning without Forgetting

[joyhuang9473]

Learning without Forgetting

• Author: Zhizhong Li, Derek Hoiem
• Origin: http://zli115.web.engr.illinois.edu/learning-without-forgetting/
• Related:
  • paper
  • code

[joyhuang9473]

methods that transfer knowledge

Hinton et al. [10]: Knowledge Distillation Romero et al. [18] Chen et al. [5]: Net2Net

Transfer Learning

(different tasks)

Pan et al. [15]

Domain Adaptation

(when old and new tasks are the same)

Deep Adaption Network by Long et al. [13]

Multitask learning

Caruana [3]

integrate knowledge over time

Lifelong Learning [22] Never Ending Learning [14] Ruvolo et al. [7]