search

OpenLLMAI / OpenRLHF

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)
https://openrlhf.readthedocs.io/
Apache License 2.0
1.72k stars 161 forks source link

debugging with ray #258

Closed mickel-liu closed 3 months ago

mickel-liu commented 3 months ago

Hi guys,

Not an issue strictly related to this repo, did you guys figure out that there is a better way to debug ray-related code other than using ray debug and pdb? Is there a way to connect ray debug to vscode? How do you guys debug this code normally? Setting ray local_mode==true could make use of the vscode debugger but it could only use a single gpu.

wuxibin89 commented 3 months ago

Ray is a distributed framework, so its debug is not natural as normal python program. For now, I would suggest ray debug and add more logging to your program.

mickel-liu commented 3 months ago

thank you, I guess there is no better way to work with it.