llama factory推理时，如何配置seed参数

hiyouga / LLaMA-Factory

Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

https://arxiv.org/abs/2403.13372

Apache License 2.0

34.07k stars 4.2k forks source link

llama factory推理时，如何配置seed参数 #3834

Closed yecphaha closed 5 months ago

yecphaha commented 5 months ago

Reminder

[X] I have read the README and searched the existing issues.

Reproduction

python src/api_demo.py \ --model_name_or_path /model/Qwen1.5-7B-Chat \ --adapter_name_or_path /qwen_model/lora/qwen1_5_7b_contract_100_sft_90 \ --template qwen \ --finetuning_type lora \ --max_new_tokens 28672

Expected behavior

请问在用llama factory推理时，如何配置seed参数

System Info

No response

Others

No response

hiyouga commented 5 months ago

推理暂不支持 seed

yecphaha commented 5 months ago

推理暂不支持 seed

请问在做SFT的时候，seed默认值是多少呀？

hiyouga commented 5 months ago

@yecphaha 42