mmderakhshani / LifeLonger

Base Code of "LifeLonger: A Benchmark for Continual Disease Classification, MICCAI, 2022"
19 stars 1 forks source link

Did you use gridsearch? I have some questions about experiment results. #5

Closed jmin0530 closed 1 year ago

jmin0530 commented 1 year ago

Thank you for your good paper and code. But I have a few questions.

  1. There is no mention of "Gridsearch" in the paper, but there is "GridSearch" in your Git code. I wonder if you used "Gridsearch" in the paper experiment you wrote.

  2. SH files in the posted script are set to use 200 exemplars for all methods. I wonder if you used the 200 exemplars for all CL methods from the experiment in your paper.

  3. I tried to run the code as it was your Git code. In particular, the results were different from the Figure 2 of your paper, and when compared to the Table 2, they also were different. I wonder if I missed something.

  4. It seems your code uses ResNet-18 taken from Torchvision models. Did you use ResNet-18 without modification? Because MedMNIST datasets image size are (28 28), not (224 224).