kohjingyu / gill

🐟 Code and models for the NeurIPS 2023 paper "Generating Images with Multimodal Language Models".
https://jykoh.com/gill
Apache License 2.0
433 stars 38 forks source link

How to get cc3m_embeddings #26

Closed Control-derek closed 1 year ago

Control-derek commented 1 year ago

Hi Authors,

How did you get cc3m_embeddings.npy ? Do you use the trained vision encoder and linear project layer? Or you only use the method of Vector database(I don't know about the Vector database at all)

Thank you!

kohjingyu commented 1 year ago

Hi, I realized this script wasn't added before, so here it is now: https://github.com/kohjingyu/gill/blob/main/scripts/extract_img_embs.py

Hope that helps!