adds wandb to CI, fixes seed

modal-labs / llm-finetuning

Guide for fine-tuning Llama/Mistral/CodeLlama models and more

MIT License

538 stars 84 forks source link

adds wandb to CI, fixes seed #61

Closed charlesfrye closed 6 months ago

charlesfrye commented 6 months ago

see this dashboard

charlesfrye commented 6 months ago

[SQL] is sometimes getting left off -- should separate out a validation set to reduce randomness so i don't have to go fishing for a seed that gives good behavior.