-
### System Info
- Ubuntu 22.04
- Python 3.10.12
- Transformers Version: from source
### Who can help?
@ArthurZucker
### Information
- [ ] The official example scripts
- [x] My own m…
-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
Tried Generation Test Set from Together APIs and Hugging Face…
-
Hello,
I have followed the steps to install LLM2Vec from the GitHub repository and I'm trying to run the example code found on HuggingFace: https://huggingface.co/McGill-NLP/LLM2Vec-Mistral-7B-Inst…
-
### Feature Description
Add support for MistralAI foundation models in the llama-index-integrations/llms/llama-index-llms-bedrock package.
Model IDs:
- mistral.mistral-7b-instruct-v0:2
- mistr…
-
### Your current environment
```text
PyTorch version: 2.4.0.dev20240415+rocm6.0
Is debug build: False
CUDA used to build PyTorch: N/A
ROCM used to build PyTorch: 6.0.32830-d62f6a171
OS: Ubuntu…
-
When running a model with ```--model-mode flashinfer``` (I have tested ```mistralai/Mistral-7B-Instruct-v0.2```), for a large batch (eg 50,000 text input), I usually see that the throughput is high th…
-
My crew was supported by Mistral AI API before at v0.55.
However it doesn't work in v.0.14.3. Is there anything I missed ? thank you.
my snippet code :
```python
from langchain_mistralai.c…
-
The [the Mistral docs Azure AI page](https://docs.mistral.ai/cloud-deployment/azure/#going-further) links to a notebook that shows that Mistral on Azure is compatible with the openai python package ht…
-
#### Context: I'm unable to run the Gen AI blueprints and following along with the examples provided here [Data EKS Gen AI examples](https://awslabs.github.io/data-on-eks/docs/gen-ai/inference/Stable…
-
Python3.12
garak --version
garak LLM security probe v0.9.0.12 ( https://github.com/leondz/garak ) at 2024-03-13T16:54:09.098209
Running any model from garak results in an error:
```
garak --…