Help: Where is the example for longlora and streaming llm

hiyouga / LLaMA-Factory

A WebUI for Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

https://arxiv.org/abs/2403.13372

Apache License 2.0

27.44k stars 3.38k forks source link

Help: Where is the example for longlora and streaming llm #3393

Closed janenie closed 3 months ago

janenie commented 3 months ago

Reminder

[X] I have read the README and searched the existing issues.

Reproduction

Hi, I am quite new to llama factory framework, I am not able to find the config.yaml for longlora and streaming llm support.

Expected behavior

No response

System Info

No response

Others

No response

hiyouga commented 3 months ago

we do not support streamingllm yet. you could specify --shift_attn for the llama model to enable longlora, but we recommend using --use_unsloth for long sequence training now