ggerganov / llama.cpp

LLM inference in C/C++
MIT License
67.21k stars 9.64k forks source link

Feature Request: Ovis1.5-Gemma2-9B model support? #8940

Closed liuzl closed 1 month ago

liuzl commented 2 months ago

Prerequisites

Feature Description

Add support for the Ovis1.5-Gemma2-9B model in llama.cpp.

Motivation

It would be highly beneficial if this model could be made compatible with GGUF, similar to how LLaVA is supported. In my experience, this model has performed exceptionally well.

Possible Implementation

No response

liuzl commented 2 months ago

https://huggingface.co/AIDC-AI/Ovis1.5-Gemma2-9B

github-actions[bot] commented 1 month ago

This issue was closed because it has been inactive for 14 days since being marked as stale.

Technetium1 commented 1 month ago

bump