Recently i discovered Dllama.dll ( https://github.com/tinyBigGAMES/Dllama ), lib that allows to chat with llm ggufs using only one simple function call. For example, i call it from my AutoIt script like this:
So it's very attractive for novice coders because doesn't require knowledge about advanced coding technics like pointers, structures etc which are used in original llama.dll from llama.cpp repo making it not newbie-friendly.
Could you add such simple function to stable-diffusion.dll, please?
Recently i discovered Dllama.dll ( https://github.com/tinyBigGAMES/Dllama ), lib that allows to chat with llm ggufs using only one simple function call. For example, i call it from my AutoIt script like this:
Local $hDLL = DllOpen("Dllama.dll") Local $answer = DllCall($hDLL, "str:cdecl", "Dllama_Simple_Inference", "str", "C:\LLM\gguf\", "str", "models2.json", "str", "llama3:8B:Q6", "boolean", False, "uint", 1024, "int", 27, "str", $question) DllClose($hDLL)
So it's very attractive for novice coders because doesn't require knowledge about advanced coding technics like pointers, structures etc which are used in original llama.dll from llama.cpp repo making it not newbie-friendly.
Could you add such simple function to stable-diffusion.dll, please?