modal-labs / llm-finetuning

Guide for fine-tuning Llama/Mistral/CodeLlama models and more
MIT License
537 stars 83 forks source link

Proposal: Get Rid of Gradio Interface #45

Closed hamelsmu closed 7 months ago

hamelsmu commented 7 months ago

I spent some time playing with the Gradio interface for the axolotl trainer. Here are my impressions:

My suggestion is to get rid of the gradio app as it expands the surface area of this tutorial and application in ways that don't seem worth it. That way, we can have a more focused experience but also make this code more maintainable. I think deleting that part of the code will let modal really shine.

cc: @charlesfrye

hamelsmu commented 7 months ago

See this slack discussion with @mwaskom

image