When the instructlab training library is imported, it seems to import a lot of packages
throughout the project such as deepspeed, pytorch, and others which all slow everything down
before anything has started running. We should optimize this to only use what's needed and where it's needed.
ktam3
commented
1 month ago
When the instructlab training library is imported, it seems to import a lot of packages throughout the project such as deepspeed, pytorch, and others which all slow everything down before anything has started running. We should optimize this to only use what's needed and where it's needed.