danielgross / LlamaAcademy

A school for camelids
MIT License
1.21k stars 77 forks source link

Save + Index + Share various training advancements as diffs? #7

Open vRobM opened 1 year ago

vRobM commented 1 year ago

It seems individual model training is lost to other users, which would be more beneficial to share and use each run to improve the model for all, over time improving the base model beyond what any single 'student' can do on its own.

Similar to llama_index for external data, can you have an 'awesome llama learnings' collection as easily integrate diffs one can merge for their own needs or to a single central model, making it the sum greater than all the parts?

That would be grand