-
### bug描述 Describe the Bug
在Ubuntu 24.04+GCC13.2+python3.12的环境下，开启-DWITH_CINN编译Paddle-3.0-beta2会报错
目前Paddle是从https://paddle-inference-dist.bj.bcebos.com/CINN/llvm11-glibc2.17.tar.gz 下载的预编好的clang++…
-
### Your current environment
The output of `python collect_env.py`
```text
(xinf) root@DESKTOP-ESRGKIB:~/vllm# python3 collect_env.py
Collecting environment information...
PyTorch version: 2…
-
After converting my PyTorch model to ONNX format, I noticed an issue with CUDA memory management. When processing a large input, the CUDA memory usage spikes as expected. However, for subsequent small…
-
### Your current environment
```text
[infxGPU Msg(52547:140064190512000:libvgpu.c:872)]: Initializing...
Collecting environment information...
[infxGPU Msg(52547:140064190512000:hook.c:400)]: load…
-
Is there any example code to do this? Should I generate new BlockMask everytime?
Thanks!
------------------------------
Essentially, I have problem of slicing BlockMask. For exmaple, if we have…
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
- [X] 3. Please note that if the bug-related issue y…
-
### Describe the issue
i'm using cascade mask rcnn model in detectron2. when export onnx, it has RoiAlign (opset 16 version) in model file.
when running on onnxruntime (Cuda EP), it's too slow since…
-
### Version
25.02
### Which installation method(s) does this occur on?
_No response_
### Describe the bug.
When running ./docker/build_container_release.sh i enconter the the following issue on …
-
Hi there, I'm trying to get the intel-extension-for-tensorflow working on my Core Ultra 5 125H Arc Graphics, and I have made a docker container as in the docs. However, while running env_check.py, I g…
-
{'web_address': '0.0.0.0:9977', 'lang': 'zh', 'devtype': 'cuda', 'cuda_com_type': 'int8', 'beam_size': 1, 'best_of': 1, 'vad': True, 'temperature': 0, 'condition_on_previous_text': False, 'initial_pro…