foundation-model-stack / fms-hf-tuning

🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
Apache License 2.0
28 stars 48 forks source link

build: install additional fms-acceleration plugins #350

Closed anhuong closed 2 months ago

anhuong commented 2 months ago

Description of the change

Users of the image will be able to automatically use padding free, multipack, and fast kernels via the fms-acceleration plugins.

Related issue number

NA

How to verify the PR

Tested the installation and running tuning with and without the flags. Just because they are installed does not mean they are enabled, the user must still pass the necessary flags/configs.

Was the PR tested

github-actions[bot] commented 2 months ago

Thanks for making a pull request! 😃 One of the maintainers will review and advise on the next steps.