when I am running RLHF script, I encountered a error

[liuzhiyong01]

My environments setting: deepspeed==0.9.0, torch==2.0.0+cu117 CUDA Version: 11.0 pretrained model is facebook/opt-350m

Who can help me solve this problem? Thanks

[liuzhiyong01]

when I set enable_hybrid_engine=False, it's solved, what is the reason?

[nbl97]

+1, same issue

[geldarr]

+1