search

datamllab / LongLM

[ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
https://arxiv.org/pdf/2401.01325.pdf
MIT License
549 stars 54 forks source link

Export weights #19

Closed fakerybakery closed 4 months ago

fakerybakery commented 4 months ago

Hi, Thank you for releasing this! Can I save Phi 2 weights with self-extend to finetune on? Thank you!

Mooler0410 commented 4 months ago

It's tuning-free.