LLaVa + llama.cpp support?

mhaowork / amblegpt

Video surveilance footage analyst powered by GPT-4o

MIT License

112 stars 21 forks source link

LLaVa + llama.cpp support? #12

Open roger- opened 9 months ago

roger- commented 9 months ago

Just wondering if anyone has tried this.

mhaowork commented 8 months ago

I tried Llava's online demo last year. The results were far worse than GPT-4's, unfortunately. But it could be a low cost low expectation option if you self host it.