arcee-ai / mergekit

Tools for merging pretrained large language models.
GNU Lesser General Public License v3.0
4.57k stars 406 forks source link

Add support for `subfolder` loading #318

Open xzuyn opened 4 months ago

xzuyn commented 4 months ago

from_pretrained can handle subfolder which would allow you to select specific checkpoints if they were just folders in a repo. Right now I just see revision supported by using @ or - revision:, so this would be nice to have.

https://huggingface.co/docs/transformers/en/main_classes/model#transformers.PreTrainedModel.from_pretrained.subfolder

Maybe subfolder can be taken in with * like this?