datamllab / LongLM

[ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
https://arxiv.org/pdf/2401.01325.pdf
MIT License
549 stars 54 forks source link

Example for gemma & use with Ollama #24

Closed vishal-android-freak closed 3 months ago

vishal-android-freak commented 3 months ago

Any example of how the extention can be done on the gemma models? Also, once the models are extended, how can they be exported to use with Ollama? Ollama uses gguf format

vishal-android-freak commented 3 months ago

@ahxt or anyone, any idea on this?

ariG23498 commented 3 months ago

@vishal-android-freak I have added a PR that introduces gemma's example -- hope that would be helpful for you.

25

vishal-android-freak commented 3 months ago

Thanks for this :) Really appreciate it! Is there a way to export this modified model to use with Ollama?

On Fri, 15 Mar, 2024, 2:06 am Aritra Roy Gosthipaty, < @.***> wrote:

@vishal-android-freak https://github.com/vishal-android-freak I have added a PR that introduces gemma's example -- hope that would be helpful for you.

25 https://github.com/datamllab/LongLM/pull/25

— Reply to this email directly, view it on GitHub https://github.com/datamllab/LongLM/issues/24#issuecomment-1998432547, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABG75Y5WXH4YIW5JXIVDDEDYYIC33AVCNFSM6AAAAABEOXFGXWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSOJYGQZTENJUG4 . You are receiving this because you were mentioned.Message ID: @.***>

Mooler0410 commented 3 months ago

Thanks for this :) Really appreciate it! Is there a way to export this

modified model to use with Ollama?

On Fri, 15 Mar, 2024, 2:06 am Aritra Roy Gosthipaty, <

@.***> wrote:

@vishal-android-freak https://github.com/vishal-android-freak I have

added a PR that introduces gemma's example -- hope that would be helpful

for you.

25 https://github.com/datamllab/LongLM/pull/25

Reply to this email directly, view it on GitHub

https://github.com/datamllab/LongLM/issues/24#issuecomment-1998432547,

or unsubscribe

https://github.com/notifications/unsubscribe-auth/ABG75Y5WXH4YIW5JXIVDDEDYYIC33AVCNFSM6AAAAABEOXFGXWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSOJYGQZTENJUG4

.

You are receiving this because you were mentioned.Message ID:

@.***>

Hi, we just refactored this repo. Now you can more easily integrate selfextend into your codes.

vishal-android-freak commented 3 months ago

Thanks for all the amazing work :)