search

togethercomputer / OpenChatKit

Apache License 2.0
9.01k stars 1.02k forks source link

add script: merge the lora weights to the base model #136

Open madroidmaq opened 1 year ago

madroidmaq commented 1 year ago

add script to merge the lora weights to the base model. The output merged model looks like this：

image

Thanks to @orangetin for the solution.

see more: https://github.com/togethercomputer/OpenChatKit/pull/113#issuecomment-1581085627 https://github.com/togethercomputer/OpenChatKit/issues/127#issuecomment-1584961110