LLaVA-VL / LLaVA-NeXT

Apache License 2.0
2.52k stars 186 forks source link

Request for Detailed Parameter Breakdown of LLaVA-NeXT-Interleave 7B Model and VRAM Requirements #181

Open YoungjaeDev opened 1 month ago

YoungjaeDev commented 1 month ago

I'm looking for specific information about the LLaVA-NeXT-Interleave 7B model

  1. Detailed parameter breakdown

    1. Language Model (LLM) size
    2. Image Encoder size
    3. Projector size
  2. VRAM requirements for evaluation: I'm encountering OOM (Out of Memory) errors when trying to evaluate the 7B model. What is the minimum VRAM required to successfully run the evaluation?