-
### Describe the bug
I'm experiencing an unexpected behavior when trying to load the following model:
Model name: Mistral-Large-Instruct-2407-IMat-GGUF
Quantization: Q6_K, size 100.59GB
When…
ro99 updated
3 months ago
-
Curious here if anyone has done/planned for running agentbench on any mistral models yet?
Mixtral 8x7b seems like one of the best open source models at the moment and the new mistral large suppose…
-
I keep getting "CUDA out of memory" during training when finetuning Mistral 7B. My hardware is an NVIDIA A10G single GPU with 24GB GPU memory. The error message looks like this:
> torch.cuda.OutOfMem…
-
The current version requires an Internet connection to download the models when it is first used after deployment.
Will the future add ways to deploy without the Internet? This will make LibrePhoto…
-
Hi,
i try to build a simple RAG script to load a pdf file (~8 pages, _that is not very large but maybe i'm wrong_), at the first question i ask, i've the the error:
`The message history is longer th…
-
I get the the error when I run `gptel-send` with the following configurations. It also takes 10 minutes before the response arrives. I also got `Response Error: nil` sometimes.
```
(setq-def…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a…
-
Recent customer feedback indicates users are struggling to move beyond the basic AI-powered search tutorial and implement hybrid search in their own projects. One specific thing users who are already …
-
I have tried to get several different models to generate captions, keywords, etc, for this image:
Some of the results are…
-
With larger models, like Mistral-Large, I encounter that the UI-endpoint I am using (for example Typing Mind) loses connection with the endpoint, but generation continues in the background and doesn't…