Cuda out of Memory with function adapt

[Yi-Owl]

The method of adapt in MAML will continously occupied the memory, thus result in Cuda out of Memory error with too many adapt using. I've printed the memory allocated after every times cuda memory changing. How to solve the problem if I want to adapt with more adapt steps and more data ?

[seba-1511]

Hello @Yi-Owl,

There's no solution if you want to back-propagate through the adaptation steps.

If you don't need to back-propagate, setting first_order=True in adapt() should do it. See the docs.