-
when I run build_win.bat, I get a deepspeed whl file finnally. The matter seems to have been resolved. However, when I ran the program, the following issue occurred
File "D:\anaconda3\envs\llm\li…
-
https://github.com/llm-jp/llm-jp-eval/pull/115 の `offline_inference_example.py` を参考にFastGenでオフライン推論処理を実装する。
-
### 问题描述 Issue Description
源码编译过程中使用命令`time cmake .. -DPY_VERSION=3.10 -DWITH_GPU=ON -DWITH_TESTING=ON`遇到如下问题:
```bash
-- commit: f8a40a7d3e
-- branch: develop
/home/sun/anaconda3/envs/paddle-d…
-
### System Info
CPU Architecture: x86_64
CPU/Host memory size: 1024Gi (1.0Ti)
GPU properties:
GPU name: NVIDIA GeForce RTX 4090
GPU mem size: 24Gb…
-
### Your current environment
```text
安装完之后,直接运行python examples/minicpmv_example.py出现的问题
INFO 06-27 10:16:32 utils.py:598] Found nccl from environment variable VLLM_NCCL_SO_PATH=/usr/local/lib/pytho…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a sim…
-
When trying to run speech. py I am getting this error:
```
speech.py", line 333, in
from TTS.tts.configs.xtts_config import XttsConfig
ModuleNotFoundError: No module named 'TTS'
```
I …
-
### System Info
ubuntu 20.04
tensorrt 10.0.1
tensorrt-cu12 10.0.1
tensorrt-cu12-bindings 10.0.1
tensorrt-cu12-libs 10.0.1
tensorrt-llm 0.10.…
-
### System Info
ubuntu 20.04
tensorrt 10.0.1
tensorrt-cu12 10.0.1
tensorrt-cu12-bindings 10.0.1
tensorrt-cu12-libs 10.0.1
tensorrt-llm …
-
When I tried to add the model support for fairseq model following ops are not present,
AdaptiveSoftmax,
BaseLayer,
FairseqDropout,
LayerDropModuleList,
LayerNorm,
PositionalEmbedding,
Sinus…