-
### Software
Desktop Application
### Operating System / Platform
Windows
### Your Pieces OS Version
latest
### Early Access Program
- [ ] Yes, this is related to an Early Access Program feature…
-
## 🐛 Bug
I tried to use Mistral Small 7B Instruct v0.3 as draft model for Mistral Large 2407. When not served using "--mode server", the model(s) never respond. I think that's because only CPU is u…
-
Hi,
I have a multi node setup with multiple GPU. I was able to get the cluster but I don't see the remaining GPU's from each nodes. How do I do that. Also observed below error while using llama…
-
Hi team,
Could you extend the tools support to AWS Bedrock models?
Amazon Bedrock supports tool calling with the following models.
Anthropic Claude 3 models
Mistral AI Large
Cohere…
DEG-7 updated
2 weeks ago
-
### Describe the issue
First of all, thank you for your great contributions.
I have a similar question to the [issue 146](https://github.com/microsoft/LLMLingua/issues/146), I cannot reproduce the…
-
[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question.
**Your Question**
Getting Error: **AttributeError: 'Generation' object h…
-
mistral ai is powerful and cheap also it's open source , and noting the mission of agent-zero it would be pretty cool to have.
-
I was trying to find where to set which quantisation to use for the K/V context cache and it seems you can't in LM Studio.
K/V cache quantisation is required to run models context efficiently by re…
-
Hi,
I tested the new langchain-ibm version, it works good for mistral-large.
However with llama-3.1-70B I got the following error:
```
ibm_watsonx_ai.wml_client_error.ApiRequestFailure: Failu…
-
**Bug description**
When I create a RAG Application with SimilaritySearch, the search returns similar documents when using Azure OpenAI, but always returns zero documents with Ollama. The issue occur…