rois-codh / kmnist

Repository for Kuzushiji-MNIST, Kuzushiji-49, and Kuzushiji-Kanji
Creative Commons Attribution Share Alike 4.0 International
695 stars 96 forks source link

Benchmark: Thin ResNet #16

Open ClashLuke opened 4 years ago

ClashLuke commented 4 years ago

Default ResNet-18 with one quarter of the usual width and its performance can be seen in this notebook (with outputs).\ The best accuracy achieved (on K49) is 98.29%. Please excuse K49 being called KMNIST inside of the notebook.

As minor dataset augmentation and adaptive learning rate scheduling are used, which are both not part of the original ResNet paper, this might have to be marked differently though.

Below "Dense" means that the InDeDeNet was used. Exploration is done on K49, implying that results can be shared as well.

Using the notebook above, here are a few more configurations Dense Width Factor Depth Parameters Accuracy
False 1/4 10 535.2k 96.82
False 1/3 10 584.4k 97.22
True 1/4 10 598.3K 97.52
False 1/3 18 1.2M 98.14
False 1/4 101 2.6M 98.20
False 1/2 18 2.8M 98.28
True 1/2 10 2.4M 98.28