kto训练完如何预测

[tcxia]

Reminder

• [X] I have read the README and searched the existing issues.

System Info

如题，如何利用kto结果对数据进行评估

Reproduction

CUDA_VISIBLE_DEVICES=0 torchrun \ --nproc_per_node $NPROC_PER_NODE \ --nnodes $NNODES \ --node_rank $RANK \ --master_addr $MASTER_ADDR \ --master_port $MASTER_PORT \ src/train.py examples/aigc_train/llama3/llama3_lora_kto_predict.yaml | tee infer_aigc_kto_llama3.log

Expected behavior

No response

Others

No response

[hiyouga]

用 examples 里面的批量预测

[tcxia]

KTO的运行脚本里面，好像没有do_predict的选项？

[hiyouga]

用 sft 的