khai-meetkai
commented
1 month ago - integrate https://github.com/linkedin/Liger-Kernel into training, this can reduce the memory and speed.
- Also update the versions for requirements
- Refactor train.py and train_lora.py