Make DeepSpeed an optional requirement

instructlab / training

InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data

https://pypi.org/project/instructlab-training/

Apache License 2.0

20 stars 44 forks source link

Make DeepSpeed an optional requirement #250

Open RobotSail opened 1 month ago

RobotSail commented 1 month ago

In main_ds.py and possibly other files, we import DeepSpeed at the top level regardless if it's installed or not. To make it truly optional, we should either make this an either a conditional or try/catch import, or just remove it entirely.

Harthi7 commented 1 month ago

Hello @RobotSail I made a PR for this issue https://github.com/instructlab/training/pull/267 , Please let me know if I missed anything