Open kubs0ne opened 3 months ago
I haven’t tested in a while but this repo should have examples for both this llava cpp server as well as llama.cpp (which I recommend you switch to because it is being actively developed still): https://github.com/trzy/multimodal-cloud-tests/blob/main/llava-cpp-test.py
Hello, I was able to successfully run the server using the repo. However I am wondering how to perform an API call with python requests library. I was trying to do it like this:
I always get 404 error.