Unit 4. Multimodal models transfer learning. Introduction

johko / computer-vision-course

This repo is the homebase of a community driven course on Computer Vision with Neural Networks. Feel free to join us on the Hugging Face discord: hf.co/join/discord

MIT License

376 stars 124 forks source link

Unit 4. Multimodal models transfer learning. Introduction #98

Closed minemile closed 6 months ago

minemile commented 7 months ago

Hi all! We have prepared an introduction to the chapter on multimodal models transfer learning.

Comments:

I've tried to keep the introduction fairly short as a reminder of the basic concepts.
Most of the links in the chapter are stubs for now, but they will be updated as jupyter notebooks are added.
It's probably worth adding another section about PEFT. What do you think?

I will be glad to any feedback!

Zekrom-7780 commented 7 months ago

@minemile this looks good in reading, no problems there from my side. But maybe could you talk about layer freezing and like gradual unfreezing here? Or would this be a later part, and not in the intro?

minemile commented 7 months ago

@minemile this looks good in reading, no problems there from my side. But maybe could you talk about layer freezing and like gradual unfreezing here? Or would this be a later part, and not in the intro?

Hello! Thanks for your comments! This approach will be discussed at https://github.com/johko/computer-vision-course/issues/53 and we may have some overlap in content. If this is not a problem, then I will add brief information about these methods in the introduction. сс - @johko

minemile commented 6 months ago

@merveenoyan. Thanks for the suggestions! I left a few comments.