search

BBC-Esq / VectorDB-Plugin-for-LM-Studio

Plugin that lets you use LM Studio to ask questions about your documents including audio and video files.
247 stars 34 forks source link

test and possibly incorporate new vision models #163

Closed BBC-Esq closed 5 days ago

BBC-Esq commented 2 months ago

Tested and it has very good quality for the size:

https://huggingface.co/openbmb/MiniCPM-V-2

BBC-Esq commented 2 months ago

Also...

https://huggingface.co/openbmb/MiniCPM-Llama3-V-2_5 (good)

https://huggingface.co/openbmb/MiniCPM-Llama3-V-2_5-int4 (good)

https://huggingface.co/qresearch/llama-3-vision-alpha-hf

https://huggingface.co/qnguyen3/nanoLLaVA (mediocre)

https://huggingface.co/microsoft/Phi-3-vision-128k-instruct (decent)

https://huggingface.co/THUDM/cogvlm2-llama3-chat-19B (not able to get working)

https://huggingface.co/collections/google/paligemma-ft-models-6643b03efb769dad650d2dda (couldn't get to work)

https://huggingface.co/THUDM/cogvlm2-llama3-chat-19B-int4 (couldn't get to work - compiling triton error)

https://huggingface.co/microsoft/Phi-3-vision-128k-instruct (above average)

BBC-Esq commented 1 month ago

https://huggingface.co/BAAI/Bunny-v1_1-Llama-3-8B-V (very good)

https://huggingface.co/BAAI/Bunny-v1_1-4B (very good)

https://huggingface.co/lmms-lab/llama3-llava-next-8b