How long does it take to merge three 7B models for different methods (PS, DFS, PS+DFS)?
Shisa Gamma 7B v1
WizardMath 7B v1.1
Abel 7B 002
And what are the system requirements to do the merge? Do I need to load 7B models simultaneously and merge them on GPUs or I can merge them lazily on disk like mergekit and load them to GPUs for evolutionary?
How long does it take to merge three 7B models for different methods (PS, DFS, PS+DFS)?
And what are the system requirements to do the merge? Do I need to load 7B models simultaneously and merge them on GPUs or I can merge them lazily on disk like mergekit and load them to GPUs for evolutionary?