search

test-time-training / ttt-lm-pytorch

Official PyTorch implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States
MIT License
1.01k stars 56 forks source link

Related works #7

Closed kiriyamashinnji closed 3 months ago

kiriyamashinnji commented 3 months ago

Great work about combining test time learning with RNNs. It seems that the idea of this work is closely related to With Greater Text Comes Greater Necessity: Inference-Time Training Helps Long Text Generation, which trains a LoRA at test time to memorize the past input.

karan-dalal commented 3 months ago

Interesting, thanks for sharing.