-
**Disclaimer**
That's not a bug report but rather a question.
**To Reproduce**
- run a simplified script to download mistral-7b model from huggingface and convert it to ONNX format. That works pe…
-
![image](https://github.com/huggingface/transformers/assets/102418053/f1f9b55c-ccad-438d-8add-40a86506e21f)
i have a python code:
```
from transformers import AutoModelForCausalLM, AutoTokeniz…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a…
-
### Your current environment
```text
$ python collect_env.py
Collecting environment information...
PyTorch version: 2.2.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used …
-
### System Info
transformers==4.41.2
### Who can help?
@ArthurZucker
### Reproduction
From https://github.com/huggingface/tokenizers/issues/1552#issue-2348487489
```python
from t…
-
```[tasklist]
### Tasks
- [x] Connector and unit test projects initial check-in
- [x] Chat completion support
- [x] Embedding support
- [x] Streaming chat completion support
- [x] Function calling sup…
-
Seems like mistral is returning an error that is not handled by streaming.
```
File "/home/jon/miniconda3/envs/h2ogpt/lib/python3.10/site-packages/langchain_core/language_models/chat_models.py",…
-
### The model to consider.
Hi. Could you add support to [mistralai/Codestral-22B-v0.1](https://huggingface.co/mistralai/Codestral-22B-v0.1)?
Thanks!
### The closest model vllm already supports.
…
-
### 软件环境
```Markdown
- paddlepaddle:
- paddlepaddle-gpu:
- paddlenlp:
```
### 详细描述
```Markdown
https://github.com/PaddlePaddle/PaddleNLP/tree/develop/llm
推理
新增QWenVL 的静态图推理 #7808
模型新增
新增D…
-
### 🐛 Describe the bug
openai.OpenAIError: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable