search

berlino / seq_icl

Apache License 2.0
50 stars 2 forks source link

Is it possible to train from original checkpoint? #9

Closed Ina299 closed 8 months ago

Ina299 commented 9 months ago

I want to try this NGH, but I have already trained a lot on normal RetNet. Does NGH work with learned model?

ekinakyurek commented 9 months ago

No, but you can try adding NGH and then finetuning your model.