Vision-Intelligence-and-Robots-Group / Best-Incremental-Learning

An Incremental Learning, Continual Learning, and Life-Long Learning Repository
543 stars 50 forks source link
catastrophic-forgetting continual-learning continuous-learning incremental-learning lifelong-learning

Best Incremental Learning

Incremental Learning Repository: A collection of documents, papers, source code, and talks for incremental learning.

Keywords: Incremental Learning, Continual Learning, Continuous Learning, Lifelong Learning, Catastrophic Forgetting

CATALOGUE

Quick Start :sparkles: Survey :sparkles: Papers by Categories :sparkles: Datasets :sparkles: Tutorial, Workshop, & Talks

Competitions :sparkles: Awesome Reference :sparkles: Full Paper List

1 Quick Start

Continual Learning | Papers With Code

Incremental Learning | Papers With Code

Class Incremental Learning from the Past to Present by 思悥 | 知乎 (In Chinese)

A Little Survey of Incremental Learning | 知乎 (In Chinese)

Origin of the Study

Toolbox & Framework

Books

2 Survey

2.1 Surveys

2.2 Analysis & Study

2.3 Settings

3 Papers by Categories

Tips: you can use ctrl+F to match abbreviations with articles, or browse the paper list below.

3.1 From an Algorithm Perspective

Network Structure Rehearsal
2024 SEED(ICLR 2024)[paper]
CAMA(ICLR 2024)[paper][code]
SFR(ICLR 2024)[paper][code]
HLOP(ICLR 2024)[paper]
TPL(ICLR 2024)[paper][code]
EFC(ICLR 2024)[paper]
PICLE(ICLR 2024)[paper]
OVOR(ICLR 2024)[paper][code]
PEC(ICLR 2024)[paper][code]
refresh learning(ICLR 2024)[paper]
POCON(WACV 2024)[paper]
CLTA(WACV 2024)[paper][code]
FG-KSR(AAAI 2024)[paper][code]
MOSE(CVPR 2024)[paper][code]
AISEOCL(Pattern Recognition 2024)[paper]
AF-FCL(ICLR 2024)[paper][code]
DietCL(ICLR 2024)[paper]
BGS(ICLR 2024)[paper]
DMU(WACV 2024)[paper][code]
2023 A-Prompts (arXiv 2023)[paper]
ESN(AAAI 2023)[paper][code]GitHub stars
RevisitingCIL(arXiv 2023)[paper][code]GitHub stars
LwP(ICLR 2023)[paper]
SDMLP(ICLR 2023)[paper]
SaLinA(ICLR 2023)[paper][code]
BEEF(ICLR 2023)[paper][code]GitHub stars
WaRP(ICLR 2023)[paper]
OBC(ICLR 2023)[paper]
NC-FSCIL(ICLR 2023)[paper][code]GitHub stars
iVoro(ICLR 2023)[paper]
DAS(ICLR 2023)[paper]
Progressive Prompts(ICLR 2023)[paper]
SDP(ICLR 2023)[paper][code]GitHub stars
iLDR(ICLR 2023)[paper]
SoftNet-FSCIL(ICLR 2023)[paper][code]GitHub stars
PAR(CVPR 2023)[paper]
PETAL(CVPR 2023)[paper][code]GitHub stars
SAVC(CVPR 2023)[paper][code]GitHub stars
CODA-Prompt(CVPR 2023)[paper][code]GitHub stars
FeTrIL(WACV 2023)[paper][code]GitHub stars
ESMER(ICLR 2023)[paper][code]GitHub stars
MEMO(ICLR 2023)[paper][code]GitHub stars
CUDOS(ICLR 2023)[paper]
ACGAN(ICLR 2023)[paper][code]GitHub stars
TAMiL(ICLR 2023)[paper][code]GitHub stars
RSOI(CVPR 2023)[paper][code]GitHub stars
TBBN(CVPR 2023)[paper]
AMSS(CVPR 2023)[paper]
DGCL(CVPR 2023)[paper]
PCR(CVPR 2023)[paper][code]GitHub stars
FMWISS(CVPR 2023)[paper]
CL-DETR(CVPR 2023)[paper][code]GitHub stars
PIVOT(CVPR 2023)[paper]
CIM-CIL(CVPR 2023)[paper][code]GitHub stars
DNE(CVPR 2023)[paper]
2022 RD-IOD(ACM Trans 2022)[paper]
NCM(arXiv 2022)[paper]
IPP(arXiv 2022)[paper]
Incremental-DETR(arXiv 2022)[paper]
ELI(CVPR 2022)[paper]
CASSLE(CVPR 2022)[paper][code]GitHub stars
iFS-RCNN(CVPR 2022)[paper]
WILSON(CVPR 2022)[paper][code]GitHub stars
Connector(CVPR 2022)[paper][code]GitHub stars
PAD(CVPR 2022)[paper]
ERD(CVPR 2022)[paper][code]GitHub stars
AFC(CVPR 2022)[paper][code]GitHub stars
FACT(CVPR 2022)[paper][code]GitHub stars
L2P(CVPR 2022)[paper][code]GitHub stars
MEAT(CVPR 2022)[paper][code]GitHub stars
RCIL(CVPR 2022)[paper][code]GitHub stars
ZITS(CVPR 2022)[paper][code]GitHub stars
MTPSL(CVPR 2022)[paper][code]GitHub stars
MMA(CVPR-Workshop 2022)[paper]
CoSCL(ECCV 2022)[paper][code]GitHub stars
AdNS(ECCV 2022)[paper]
ProCA(ECCV 2022)[paper][code]GitHub stars
R-DFCIL(ECCV 2022)[paper][code]GitHub stars
S3C(ECCV 2022)[paper][code]GitHub stars
H^2^(ECCV 2022)[paper]
DualPrompt(ECCV 2022)[paper]
ALICE(ECCV 2022)[paper][code]GitHub stars
RU-TIL(ECCV 2022)[paper][code]GitHub stars
FOSTER(ECCV 2022)[paper]
SSR(ICLR 2022)[paper][code]GitHub stars
RGO(ICLR 2022)[paper]
TRGP(ICLR 2022)[paper]
AGCN(ICME 2022)[paper][code]GitHub stars
WSN(ICML 2022)[paper][code]GitHub stars
NISPA(ICML 2022)[paper][code]GitHub stars
S-FSVI(ICML 2022)[paper][code]GitHub stars
CUBER(NeurIPS 2022)[paper]
ADA(NeurIPS 2022)[paper]
CLOM(NeurIPS 2022)[paper]
S-Prompt(NeurIPS 2022)[paper]
ALIFE(NIPS 2022)[paper]
PMT(NIPS 2022)[paper]
STCISS(TNNLS 2022)[paper]
DSN(TPAMI 2022)[paper]
MgSvF(TPAMI 2022)[paper]
TransIL(WACV 2022)[paper]
2021 Meta-DR(CVPR 2021)[paper]
continual cross-modal retrieval(CVPR 2021)[paper]
DER(CVPR 2021)[paper][code]GitHub stars
EFT(CVPR 2021)[paper][code]GitHub stars
PASS(CVPR 2021)[paper][code]GitHub stars
GeoDL(CVPR 2021)[paper][code]GitHub stars
IL-ReduNet(CVPR 2021)[paper]
PIGWM(CVPR 2021)[paper]
BLIP(CVPR 2021)[paper][code]GitHub stars
Adam-NSCL(CVPR 2021)[paper][code]GitHub stars
PLOP(CVPR 2021)[paper][code]GitHub stars
SDR(CVPR 2021)[paper][code]GitHub stars
SKD(CVPR 2021)[paper]
Always Be Dreaming(ICCV 2021)[paper][code]GitHub stars
SPB(ICCV 2021)[paper]
Else-Net(ICCV 2021)[paper]
LCwoF-Framework(ICCV 2021)[paper]
AFEC(NeurIPS 2021)[paper][code]GitHub stars
F2M(NeurIPS 2021)[paper][code]GitHub stars
NCL(NeurIPS 2021)[paper][code]GitHub stars
BCL(NeurIPS 2021)[paper][code]GitHub stars
Posterior Meta-Replay(NeurIPS 2021)[paper]
MARK(NeurIPS 2021)[paper][code]GitHub stars
Co-occur(NeurIPS 2021)[paper][code]GitHub stars
LINC(AAAI 2021)[paper]
CLNER(AAAI 2021)[paper]
CLIS(AAAI 2021)[paper]
PCL(AAAI 2021)[paper]
MAS3(AAAI 2021)[paper]
FSLL(AAAI 2021)[paper]
VAR-GPs(ICML 2021)[paper]
BSA(ICML 2021)[paper]
GPM(ICLR 2021)[paper][code]GitHub stars
GitHub stars
2020 CWR*(CVPR 2020)[paper]
MiB(CVPR 2020)[paper][code]GitHub stars
K-FAC(CVPR 2020)[paper]
SDC(CVPR 2020)[paper][code]GitHub stars
NLTF(AAAI 2020) [paper]
CLCL(ICLR 2020)[paper][code]GitHub stars
APD(ICLR 2020)[paper]
HYPERCL(ICLR 2020)[paper][code]GitHub stars
CN-DPM(ICLR 2020)[paper]
UCB(ICLR 2020)[paper][code]GitHub stars
CLAW(ICLR 2020)[paper]
CAT(NeurIPS 2020)[paper][code]GitHub stars
AGS-CL(NeurIPS 2020)[paper]
MERLIN(NeurIPS 2020)[paper][code]GitHub stars
OSAKA(NeurIPS 2020)[paper][code]GitHub stars
RATT(NeurIPS 2020)[paper]
CCLL(NeurIPS 2020)[paper]
CIDA(ECCV 2020)[paper]
GraphSAIL(CIKM 2020)[paper]
ANML(ECAI 2020)[paper][code]GitHub stars
ICWR(BMVC 2020)[paper]
DAM(TPAMI 2020)[paper]
OGD(PMLR 2020)[paper]
MC-OCL(ECCV2020)[paper][code]GitHub stars
RCM(ECCV 2020)[paper][code]GitHub stars
OvA-INN(IJCNN 2020)[paper]
XtarNet(ICLM 2020)[paper][code]GitHub stars
DMC(WACV 2020)[paper]
iTAML(CVPR 2020)[paper][code]GitHub stars
FSCIL(CVPR 2020)[paper][code]GitHub stars
GFR(CVPR 2020)[paper][code]GitHub stars
OSIL(CVPR 2020)[paper]
ONCE(CVPR 2020)[paper]
WA(CVPR 2020)[paper][code]
CGATE(CVPR 2020)[paper][code]GitHub stars
Mnemonics Training(CVPR 2020)[paper][code]GitHub stars
MEGA(NeurIPS 2020)[paper]
GAN Memory(NeurIPS 2020)[paper][code]GitHub stars
Coreset(NeurIPS 2020)[paper]
FROMP(NeurIPS 2020)[paper][code]GitHub stars
DER(NeurIPS 2020)[paper][code]GitHub stars
InstAParam(NeurIPS 2020)[paper]
BOCL(AAAI 2020)[paper]
REMIND(ECCV 2020)[paper][code]GitHub stars
ACL(ECCV 2020)[paper][code]GitHub stars
TPCIL(ECCV 2020)[paper]
GDumb(ECCV 2020)[paper][code]GitHub stars
PRS(ECCV 2020)[paper]
PODNet(ECCV 2020)[paper][code]GitHub stars
FA(ECCV 2020)[paper]
L-VAEGAN(ECCV 2020)[paper]
Piggyback GAN(ECCV 2020)[paper][code]GitHub stars
IDA(ECCV 2020)[paper]
RCM(ECCV 2020)[paper]
LAMOL(ICLR 2020)[paper][code]GitHub stars
FRCL(ICLR 2020)[paper][code]GitHub stars
GRS(ICLR 2020)[paper]
Brain-inspired replay(Natrue Communications 2020)[paper][code]GitHub stars
CLIFER(FG 2020)[paper]
ScaIL(WACV 2020)[paper][code]GitHub stars
ARPER(EMNLP 2020)[paper]
DnR(COLING 2020)[paper]
ADER(RecSys 2020)[paper][code]GitHub stars
MUC(ECCV 2020)[paper][code]GitHub stars
2019 LwM(CVPR 2019)[paper]
CPG(NeurIPS 2019)[paper][code]GitHub stars
UCL(NeurIPS 2019)[paper]
OML(NeurIPS 2019)[paper][code]GitHub stars
ALASSO(ICCV 2019)[paper]
Learn-to-Grow(PMLR 2019)[paper]
OWM(Nature Machine Intelligence 2019)[paper][code]GitHub stars
LUCIR(CVPR 2019)[paper][code]GitHub stars
TFCL(CVPR 2019)[paper]
GD(CVPR 2019)[paper][code]GitHub stars
DGM(CVPR 2019)[paper]
BiC(CVPR 2019)[paper][code]GitHub stars
MER(ICLR 2019)[paper][code]GitHub stars
PGMA(ICLR 2019)[paper]
A-GEM(ICLR 2019)[paper][code]GitHub stars
IL2M(ICCV 2019)[paper]
ILCAN(ICCV 2019)[paper]
Lifelong GAN(ICCV 2019)[paper]
GSS(NIPS 2019)[paper]
ER(NIPS 2019)[paper]
MIR(NIPS 2019)[paper][code]GitHub stars
RPS-Net(NIPS 2019)[paper]
CLEER(IJCAI 2019)[paper]
PAE(ICMR 2019)[paper][code]GitHub stars
2018 PackNet(CVPR 2018)[paper][code]GitHub stars
OLA(NIPS 2018)[paper]
RCL(NIPS 2018)[paper][code]GitHub stars
MARL(ICLR 2018)[paper]
DEN(ICLR 2018)[paper][code]GitHub stars
P&C(ICML 2018)[paper]
Piggyback(ECCV 2018)[paper][code]GitHub stars
RWalk(ECCV 2018)[paper]
MAS(ECCV 2018)[paper][code]GitHub stars
R-EWC(ICPR 2018)[paper][code]GitHub stars
HAT(PMLR 2018)[paper][code]GitHub stars
MeRGANs(NIPS 2018)[paper][code]GitHub stars
EEIL(ECCV 2018)[paper][code]GitHub stars
Adaptation by Distillation(ECCV 2018)[paper]
ESGR(BMVC 2018)[paper][code]GitHub stars
VCL(ICLR 2018)[paper]
FearNet(ICLR 2018)[paper]
DGDMN(ICLR 2018)[paper]
2017 Expert Gate(CVPR 2017)[paper][code]GitHub stars
ILOD(ICCV 2017)[paper][code]GitHub stars
EBLL(ICCV2017)[paper]
IMM(NIPS 2017)[paper][code]GitHub stars
SI(ICML 2017)[paper][code]GitHub stars
EWC(PNAS 2017)[paper][code]GitHub stars
iCARL(CVPR 2017)[paper][code]GitHub stars
GEM(NIPS 2017)[paper][code]GitHub stars
DGR(NIPS 2017)[paper][code]GitHub stars
2016 LwF(ECCV 2016)[paper][code]GitHub stars

3.2 From a Data Deployment Perspective

Data decentralized incremental learning

Data centralized incremental learning

All other studies aforementioned except those already in the 'Decentralized' section.

4 Datasets

datasets describes
ImageNet There are 1.28 million training images and 50,000 validation images in over 1,000 categories. Usually crop into 224×224 color image
TinyImageNet Contains 100,000 64×64 color images of 200 categories (500 per category). Each class has 500 training images, 50 validation images, and 50 test images.
MiniImageNet This dataset is a subset of ImageNet used for few-shot learning. It consists of 60, 000 colour images of size 84 × 84 with 100 classes, each having 600 examples.
SubImageNet This dataset is a 100-class subset of ImageNet's random sample, which contains approximately 130,000 images for training and 5,000 images for testing.
CIFAR-10/100 Both datasets contain 60,000 natural RGB images of the size 32 × 32, including 50,000 training and 10,000 test images. CIFAR10 has 10 classes, while CIFAR100 has 100 classes.
CORe50 This dataset consists of 164,866 128×128 RGB-D images: 11 sessions × 50 objects × (around 300) frames per session.
Github
CORe50: a New Dataset and Benchmark for Continuous Object Recognition
OpenLORIS-Object This is the first real-world dataset for robotic vision with independent and quantifiable environmental factors, compared with other lifelong learning datasets, with 186 instances, 63 categories and 2,138,050 images.

5 Lecture, Tutorial, Workshop, & Talks

Life-Long learning | 李宏毅

Life-long Learning: [ppt] [pdf]

Catastrophic Forgetting [Chinese] [English]

Mitigating Catastrophic Forgetting [Chinese] [English]

Meta Learning : Learn to Learn [Chinese]

Continual AI Lecture

Open World Lifelong Learning | A Continual Machine Learning Course

Prompting-based Continual Learning | Continual AI

VALSE Webinar (In Chinese)

20211215【学无止境:深度连续学习】洪晓鹏:记忆拓扑保持的深度增量学习方法

20211215【学无止境:深度连续学习】李玺:基于深度神经网络的持续性学习理论与方法

ACM MULTIMEDIA

ACM2021 Few-shot Learning for Multi-Modality Tasks

CVPR Workshop

CVPR 2022 Workshop on Continual Learning in Computer Vision

CVPR2021 Workshop on Continual Learning in Computer Vision

CVPR2020 Workshop on Continual Learning in Computer Vision

CVPR2017 Continuous and Open-Set Learning Workshop

ICML Tutorial/Workshop

ICML 2021 Workshop on Theory and Foundation of Continual Learning

ICML 2021 Tutorial on Continual Learning with Deep Architectures

ICML2020 Workshop on Continual Learning

NeurIPS Workshop

NeurIPS2021 4th Robot Learning Workshop: Self-Supervised and Lifelong Learning

NeurIPS2018 Continual learning Workshop

NeurIPS2016 Continual Learning and Deep Networks Workshop

IJCAI Workshop

IJCAI 2021 International Workshop on Continual Semi-Supervised Learning

ContinualAI wiki

A Non-profit Research Organization and Open Community on Continual Learning for AI

CoLLAs

Conference on Lifelong Learning Agents - CoLLAs 2022

6 Competitions

achieved

3rd CLVISION CVPR Workshop Challenge 2022

IJCAI 2021 - International Workshop on Continual Semi-Supervised Learning

2rd CLVISION CVPR Workshop Challenge 2021

1rd CLVISION CVPR Workshop Challenge 2020

7 Awesome Reference

[1] https://github.com/xialeiliu/Awesome-Incremental-Learning

8 Contact Us

Should there be any concerns on this page, please don't hesitate to let us know via hongxiaopeng@ieee.org or xl330@126.com.

Full Paper List

arXiv (If accepted, welcome corrections)

2024

2023

:gift_heart: Contributors