search

cambrian-mllm / cambrian

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.
https://cambrian-mllm.github.io/
Apache License 2.0
1.77k stars 115 forks source link

where is the sva projector? #53

Closed ZhuGeKongKong closed 4 months ago

ZhuGeKongKong commented 4 months ago

I cannot find the sva projector in the cambrian/model/multimodal_projector/ field.

penghao-wu commented 4 months ago

The sva projector is implemented at cambrian/model/vision_sampler.py in and initialized at https://github.com/cambrian-mllm/cambrian/blob/07bc9f70fb2eaa6615c36c15765c13993c66ab44/cambrian/model/cambrian_arch.py#L60 and https://github.com/cambrian-mllm/cambrian/blob/07bc9f70fb2eaa6615c36c15765c13993c66ab44/cambrian/model/cambrian_arch.py#L68.