How to train few-shot ability?

baaivision / Emu

Emu Series: Generative Multimodal Models from BAAI

https://baaivision.github.io/emu2/

Apache License 2.0

1.62k stars 85 forks source link

Closed jyC23333 closed 9 months ago

jyC23333 commented 9 months ago

Hi, Wonderful work!

I'm wondering: How many few-shot training items are used? In pretrain or in instruct tuning?

Quan-Sun commented 9 months ago

Hi @jyC23333, we used MMC4 and YT-SB-1B as interleaved image/video-text data in pretraining stage, enhancing in-context learning abilities.

jyC23333 commented 9 months ago

Thanks so much.