search

foundation-model-stack / fms-hf-tuning

🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
Apache License 2.0
22 stars 41 forks source link

initial deploy script for testing tuning and inference #222

Closed anhuong closed 1 month ago

anhuong commented 3 months ago

Description of the change

Related issue number

How to verify the PR

Was the PR tested

anhuong commented 2 months ago

Also just a thought on the location of this script. Should it be in the fmaas-tuning-docs repo since the test yamls are located there? Or maybe sft-trainer-image? The users of this repo fms-hf-tuning dont need this script right?

Good points! I think putting it in fmaas-tuning-docs could definitely work. I put it here since it is testing fms-hf-tunign and the image built and we have other scripts like running the evaluation and inference. This could be an example of how to deploy but I agree that it's our team specific and others probably wouldn't run it.