consolidating Linux training code from CLI repo

instructlab / training

InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data

https://pypi.org/project/instructlab-training/

Apache License 2.0

21 stars 45 forks source link

Open xukai92 opened 1 week ago

xukai92 commented 1 week ago

there are some codes for Linux (CPU only) in https://github.com/instructlab/instructlab/blob/main/src/instructlab/train/linux_train.py with special hardware support. i feel we best consolidating them to the training repo.

cc'ing @aldo-pareja @Maxusmusti @jaideepr97

Maxusmusti commented 6 days ago

CC'ing @cdoern as well, we likely want to pull in his updated CPU training script

Maxusmusti commented 6 days ago