-
**Describe the Issue**
All the Mistral-Large GGUF models result in Koboldcpp looping a strange error msg during inference reading **[control_76].**
**Additional Information:**
- The Koboldcpp bui…
-
I was trying to find where to set which quantisation to use for the K/V context cache and it seems you can't in LM Studio.
K/V cache quantisation is required to run models context efficiently by re…
-
After installation, click `get first LLM`, the next page is always empty. Click `skip onboard` to enter home page, seems fine, but anything that requires network will not load.
I use tools to monitor…
-
It seems that function calling is not working with Ollama and OpenAILike (with LMStudio + MLX).
I'm using Hermes Llama 3.1 model, with basic web search sample agent. Am I doing something wrong?
Ope…
-
Hi,
Will the lmstudio chat completion response be added to a logprobs in the response?
Currently, when using OpenAI in .NET library the `CreateChatCompletionResponseChoices`
the logprobs is a …
-
this model has a vision adapter: mmproj-model-f16.gguf
i never used any vision model in lmstudio, so I don´t know if that is a bug or related to this particular model.
because this model has strong …
-
Changing every setting (even os side) to italian is giving very poor voice recognition (is basically understanding nothing)
-
-
This Happened on Windows 11 and on Linux Ubuntu 24.04
GFX cards: GTX 1660 and RTX 3060 mobile.
After some time and genearting a lot of content (it happens way earlier on Linux), LM Studio window g…
-
### tl;dr
There has been a change in behavior between [`main` (e51ede12e1b639fd30c8797eb3bbd8b9fb3de826)](https://github.com/lmstudio-ai/mlx-engine/commit/e51ede12e1b639fd30c8797eb3bbd8b9fb3de826) an…