mlfoundations / model-soups

Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time
MIT License
431 stars 39 forks source link

Inquiry about Coefficients for Learned Soup #16

Open DongHwanJang opened 1 year ago

DongHwanJang commented 1 year ago

Hello,

I found the comparison between the performance of Greedy Soup and Learned Soup in your recent paper particularly intriguing. I'm reaching out to ask if you could share a log or list of coefficients for the Learned Soup that you reported.

Having access to this data would be extremely helpful for identifying potential trends among these coefficients (both by model and by layer). This information could be invaluable for replication studies, comparative analyses, or further research in the field.

I would greatly appreciate any help you can provide with this request.

Thanks for considering my inquiry.