-
### 🐛 Describe the bug
```
https://pytorch.org/executorch/stable/apple-runtime.html
./build/build_apple_frameworks.sh --coreml --custom --mps --optimized --portable --quantized --xnnpack
```
…
-
### 🐛 Describe the bug
Run following command to build for x64 on arm64 mac:
```console
cmake . -B out \
-DCMAKE_BUILD_TYPE=Release \
-DCMAKE_PREFIX_PATH=/opt/homebrew/Caskroom/miniconda/base/en…
-
Hi team, I am trying to add a custom model to TRT-LLM. The original model in PyTorch uses `torch.complex` for few tensors, in addition to FFT ops like `torch.fft.fft`, `torch.fft.ifft` and `torch.fft.…
-
### Is there an existing issue for this bug?
- [X] I have searched the existing issues
### 🐛 Describe the bug
Git commit: 2f583c1549(Current master branch)
## code(Example code in colossal…
-
### System Info / 系統信息
cuda =12.1 torch =2.3.0 transformers=4.40.0 ,显卡是Tesla V100-PCIE-32GB
### Who can help? / 谁可以帮助到您？
@Btlmd
### Information / 问题信息
- [X] The official example scripts / 官方的示例…
-
# 🐛 Bug
from vllm import LLM, SamplingParams
llm = LLM(model=model_dir,enforce_eager=True)
then
```
File d:\my\env\python3.10.10\lib\site-packages\xformers\ops\fmha\_triton\splitk_kernels.…
-
我现在用的是ffmpeg6.1.1。
我的config.yaml配置如下：
name: 百聆（bailing）
version: 1.0
logging:
level: debug
interrupt: false
# 具体处理时选择的模块
selected_module:
Recorder: RecorderPyAudio
ASR: FunASR
…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
```
[2024-10-23 02:13:28,666] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to…
-
### Your current environment
```text
The output of `python collect_env.py`
```
CODE:
from langchain.llms import VLLM
import time
import uvicorn
app = FastAPI()
llm = VLLM(model="tiiua…
-
# 🧐 Problem Description
Currently, creating a training dataset with Fast-LLM involves a multi-step, cumbersome process:
1. **Organizing Datasets:** Start with a collection of memory-mapped Megat…