where is the part of "PruMerge"?

42Shawn / LLaVA-PruMerge

LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models

Apache License 2.0

85 stars 4 forks source link

where is the part of "PruMerge"? #1

Closed muyu42 closed 4 months ago

muyu42 commented 5 months ago

In fact, I went through the entire repository and couldn't find this part of the code, and the inferred scripts in the readme didn't work because some data or files were missing

mu-cai commented 4 months ago

Hi,

The core of our prumerge is here: https://github.com/42Shawn/LLaVA-PruMerge/blob/main/llava/model/multimodal_encoder/clip_encoder.py#L85

Please have a look!