[BUG/Help] <title>如何对微调前的模型进行推理

[DOVEEEEEEEEEEEEE]

Is there an existing issue for this?

• [X] I have searched the existing issues

Current Behavior

运行evaluate.sh是对ptuning微调后的模型进行推理，我现在想对原模型进行推理，比较推理前后的rouge和bleu参数，请问要如何修改evaluate.sh？

Expected Behavior

No response

Steps To Reproduce

1

Environment

- OS:ubantu
- Python:3.8
- Transformers:4.30.2
- PyTorch:2.1 cu121
- CUDA Support (`python -c "import torch; print(torch.cuda.is_available())"`) : true

Anything else?

No response