search

arcee-ai / mergekit

Tools for merging pretrained large language models.
GNU Lesser General Public License v3.0
4.87k stars 445 forks source link

The differences in principles and effects between the various merging methods #74

Open hywchina opened 10 months ago

hywchina commented 10 months ago

Thank you very much for this open-source project, it's an excellent tool for merging large language models. I have a few questions:

  1. Could you provide a simple overview of the differences in principles and effects between the various merging methods?
  2. Is it possible to provide more detailed explanations for the parameters within the YML files for different merging methods?

Looking forward to your response, thank you very much.

fredi-python commented 10 months ago

+1