search

microsoft / DeepSpeedExamples

Example models using DeepSpeed
Apache License 2.0
6.11k stars 1.05k forks source link

Εnable reward model offloading option #930

Closed kfertakis closed 3 weeks ago

kfertakis commented 1 month ago

Provide option for reward model zero offload.

kfertakis commented 1 month ago

@microsoft-github-policy-service agree

tjruwase commented 1 month ago

@kfertakis can you please fix the formatting issue?