learnables / learn2learn

A PyTorch Library for Meta-learning Research
http://learn2learn.net
MIT License
2.59k stars 348 forks source link

Unable to Reproduce ANIL Results #422

Open ImahnShekhzadeh opened 8 months ago

ImahnShekhzadeh commented 8 months ago

Hi @seba-1511,

First of all thank you for this awesome repository! :slightly_smiling_face:

I'm currently unable to reproduce the results of the script anil_fc100.py. I took the script and only adjusted the dataset path, but after 1k iterations, I get this output:

Iteration 999
Meta Train Error 0.5174707034602761
Meta Train Accuracy 0.8399999719113111
Meta Valid Error 1.5201084688305855
Meta Valid Accuracy 0.37499999022111297
Meta Test Error 1.2440147195011377
Meta Test Accuracy 0.4924999880604446

So clearly, I'm not obtaining the results that this tutorial describes, and there's huge overfitting.

Here are my package versions:

Python version: 3.10.3
learn2learn version: 0.2.0
PyTorch version: 2.1.0