mlabonne / llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
https://mlabonne.github.io/blog/
Apache License 2.0
37.81k stars 3.97k forks source link

Any plan for Multimodality #73

Closed TheMattBin closed 4 months ago

TheMattBin commented 4 months ago

Thanks for the great work! Any plans regarding VQA finetuning using some small models (~7B or 8B)? Thanks!

mlabonne commented 4 months ago

This is something I explored a bit, I'll definitely add something at some point