ymcui / Chinese-LLaMA-Alpaca-2

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
Apache License 2.0
7.04k stars 581 forks source link

max_seq_length #427

Closed Go4miii closed 8 months ago

Go4miii commented 9 months ago

请问max_seq_length是输入长度还是输出长度?

ymcui commented 9 months ago

你问的是什么脚本或者代码?没上下文怎么回答。

Go4miii commented 9 months ago

你问的是什么脚本或者代码?没下文怎么回答。

https://github.com/ymcui/Chinese-LLaMA-Alpaca-2/wiki/sft_scripts_zh 这个网站里的训练脚本

ymcui commented 9 months ago

训练数据输入长度。具体自行查看相关代码定义: https://github.com/ymcui/Chinese-LLaMA-Alpaca-2/blob/0189e8be7706d2aceb90d238149d5fda6b6aea8d/scripts/training/build_dataset.py#L23

github-actions[bot] commented 8 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your consideration.

github-actions[bot] commented 8 months ago

Closing the issue, since no updates observed. Feel free to re-open if you need any further assistance.