jzhang38 / EasyContext

Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
Apache License 2.0
529 stars 33 forks source link

Switching to monkey patch #2

Closed jzhang38 closed 3 months ago

jzhang38 commented 3 months ago

Not fully tested yet.