search

haoliuhl / ringattention

Transformers with Arbitrarily Large Context
Apache License 2.0
630 stars 50 forks source link

Pretrained models? #10

Closed matteoguarrera closed 4 months ago

matteoguarrera commented 12 months ago

Hi there, I am working on long context model. Is it possible to have the pretrained models?

haoliuhl commented 4 months ago

Sorry about the delay. The pretrained models can be found at https://github.com/LargeWorldModel/LWM. Let us know if you have any questions.