Open XJF2332 opened 2 weeks ago
I'm getting this same issue, only im using OpenAI but everything is pretty much the same, my API key is in the env file, but no matter what i put into the node, i get the same output error like you have
I also encountered the same error, and there was a rejection from the server, I tried to replace localhost with 127.0.0.1, and also tried to add/or /v1 at the end, but in fact, it is not useful, but there is no problem with the LLM service, I tested in the application and it can return normally In addition, the local LLM node can not accept the input of pictures or videos, and it can not directly process the pictures as demonstrated. It has been tested for a long time, but it is a pity that it did not succeed. If there is any latest progress, please remember @me, thank you
and this is my workflow.it is a simple one created for testing.
local llm was loaded. please ignore last error, it was not caused by anynode.
API URL was right, and there was no API key.