-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTor…
-
**Description**
A clear and concise description of what the bug is.
I am trying to use the newly introduced [triton inference server In-Process python API](https://github.com/triton-inference-server…
-
### bug描述 Describe the Bug
https://github.com/PaddlePaddle/PaddleOCR/issues/13912
### 整个环境分别在两个主(134)从(131)机的docker容器环境下, 容器的网络是--ipc=host --network=host --gpus all;主从机已经分别指定nccl通信的网卡;ssh也已经互为免密,s…
-
I'm encountering an issue when using an EC2 g5.2xlarge instance and I'm getting the error mentioned in the title.
Description:
I'm using Whisper-X and Mistral in the same Docker container. In this…
-
Hello, very nice video, and very nice tutorial on alternatives to langchain.
I am having troubles with haystack however, I tried to overcome dependency issues but couldn't get ingest.py to work pr…
-
[model_input.txt](https://github.com/user-attachments/files/17492230/model_input.txt)
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment inform…
-
### System Info
Hello I am trying to load Mistral-Nemo Instruct-2407 in bnb 4bit on 4 A10 gpus on ec2 instance.
I upgraded all the packages.
Still I face cuda memory out of error when train batc…
-
-
### Before You Report a Bug, Please Confirm You Have Done The Following...
- [X] I have updated to the latest version of the packages.
- [x] I have searched for both [existing issues](https://github.…
-
### Report
I was trying to run TotalPseudobulk without providing any cell type information, however that gives me an error because it seems the cell type key needs to be present (and a real cell ty…