arcee-ai / mergekit

Tools for merging pretrained large language models.
GNU Lesser General Public License v3.0
4.45k stars 389 forks source link

merging native pytorch model locally #376

Open sorobedio opened 1 month ago

sorobedio commented 1 month ago

hello, is it possible to merge a local model I meant non huggingface model. what should be the parameters in such cases. what I wan is to perform some preprocessing merge the models evaluate the merge locally then save the checkpoints.

hoooooli commented 1 month ago

可以的,yml文件中的模型填写本地路径就可以,没有其他需要改变的