-
Hello,
I've been using Qdrant for a few months for RAG applications.
Recently I've been adding new GPU so I needed to reboot the application for the vector db.
And now it seems I can't use the py…
-
Hi there,
I am trying to build a custom configuration of BERT for the purpose of performance measuring only. Following the [README ](https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/gpt#4…
-
### Branch
main branch (1.x version, such as `v1.0.0`, or `dev-1.x` branch)
### Prerequisite
- [X] I have searched [Issues](https://github.com/open-mmlab/mmaction2/issues) and [Discussions](https:/…
-
我使用的是最新版本的GPT-Sovits项目与M2 8GB,前几个小时刚进行过git pull,我尝试将config.py 以及 infer_webui.py中的device判断删掉,强行使用device="cpu"进行推理,并将其速度与同版本的MPS推理进行比较。有如下发现:
1. 发现CPU推理python全程内存占用3GB,内存曲线全程绿色,推理速度长时间保持55it/s,GPU推理p…
-
### Solution to issue cannot be found in the documentation.
- [X] I checked the documentation.
### Issue
```
conda install -c conda-forge gzip
Collecting package metadata (current_repodata.…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues and checked the recent builds/commits
### What happened?
When you connect to a remote a1111 webui server over the …
-
### **Note that I don't know much about programmation. My guess is that when I installed LayerStyle and restarted Comfy it started to install requirements and removed some important function like torc…
-
> python -m nuitka --version
2.2.3
Commercial: None
Python: 3.8.10 (default, Nov 22 2023, 10:22:35)
Flavor: Debian Python
Executable: /home/wenjie/py38/bin/python
OS: Linux
Arch: x86_64
Dis…
-
I've encountered an error compiling a PyTorch extension using **`nvcc`**. Specifically, I'm on PyTorch **`2.0.1+cu117`** and CUDA **`11.8.0`**, and I've tried this on both **`A100`** and **`A40`** car…
-
Hi,
I'm having this type of error during the libraries installation:
```
(venv) [ cactus-bin-v2.0.3]$ pip install --upgrade .
Processing /user/work/tk19812/software/cactus-bin-v2.0.3
Prepar…