How to submit a LLM training job?

[qingqiuhe]

How to submit a LLM training job? Is this project just used for LLM deployment?

[msinha251]

ray-llm is only for deploying or inferencing llm over Ray.

@qingqiuhe I don't think, it supports LLM training.

[akshay-anyscale]

Are you looking for fine-tuning LLMs? RayLLM currently is only meant for inference but we do have examples for how to do fine-tuning using Ray - https://docs.ray.io/en/latest/train/examples/lightning/vicuna_13b_lightning_deepspeed_finetune.html#fine-tune-vicuna-13b-with-lightning-and-deepspeed