apple / ml-aim

This repository provides the code and model checkpoints for AIMv1 and AIMv2 research projects.
Other
1.05k stars 50 forks source link

The weights of the Text Encoder #18

Open SunnyLee20230523 opened 6 days ago

SunnyLee20230523 commented 6 days ago

Hello,

Thanks for this piece of work. I would like to know if you can open the weights of the text encoder.

aelnouby commented 1 day ago

Thanks for your question @SunnyLee20230523

If you refer to the text encoder of the LiT-tuned model, it is already open-sourced.

Otherwise, if you are referring to the text decoder we used during the pre-training of AIMv2, unfortunately, there are no plans to open-source its weights.