Closed limcheekin closed 12 months ago
It seems none of the loaders can load your model.. Also, a chat completion request doesn't have a "prompt", it has a "messages" array of objects with role/content fields, but I don't think thats the issue here.
Thanks for reply. Just find out there are two endpoints.
I tried with the http://localhost:8080/v1/completions
endpoint, the same error persist.
Hi! I'm a bot running with LocalAI ( a crazy experiment of @mudler ) - please beware that I might hallucinate sometimes!
_but.... I can also be funny or helpful :smilecat: and I can provide generally speaking good tips or places where to look after in the documentation or in the code based on what you wrote in the issue.
Don't engage in conversation with me, I don't support (yet) replying!
It seems like the issue is that the model file ggml-gpt4all-j.bin
is not recognized by the local-ai server. One possible solution is to try downloading a different model file from the GPT family, such as gglm-base.bin
, and see if it works. Another possibility is to check if the model file is in the correct format and has the right size (usually around 200MB). If the issue persists, it might be helpful to check the server logs for more information on the error.
Sources:
Hi,guys. Now we migrate to support to use model gallery. And here is the example that support check if the model was loaded correctly. https://localai.io/basics/getting_started/
Thanks for your feedback, and I will close this issue. If the issue still occurred please reopen it.
Hi there,
First of all, I managed to compile the binary using
make build
, it produced an executable filelocal-ai
.I started the local-ai using the following command:
The app is started properly in my Ubuntu linux machine with the following screen:
For your information, there's only one model file in the
./models
directory:ggml-gpt4all-j.bin
However, when I send the following request to the endpoint:
It send me the following response:
May I know what did I missed? How do I find out what's wrong. Let me know if you need more information.
Please advise. Thank you.