Whether inner loop during the training period

test-time-training / ttt-lm-pytorch

Official PyTorch implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States

MIT License

1.01k stars 56 forks source link

Whether inner loop during the training period #18

Closed LJHzju closed 2 months ago

LJHzju commented 2 months ago

Hi, I would like to know whether the model needs to use test time learning to update the relevant parameters of the inner loop during the training period.

karan-dalal commented 2 months ago

During training, we learn to learn the parameters that are updated during test time. See Section 2.2 of our paper for more details.