-
Hi, are there any plans for C++ libtorch interface? Regards,
-
### Your current environment
### Model Input Dumps
_No response_
### 🐛 Describe the bug
(demo_vllm) demo@dgx03:/raid/xinference/modelscope/hub/qwen/Qwen2-72B-Instruct/logs$ tail -f vllm_20240927…
-
I think the Readme needs to define the following:
- Libtorch version in use.
- CUDA version in use.
I have ran into a lot of issues with compiling using CUDA 12.2 and Libtorch 2.4.1. I think we…
-
rl_sim包中的CMakeLists出现问题，find_package所有包都找不到，换catkin_make出现以下报错
`home/ros/tmp/libtorch/libtorch/include/torch/csrc/jit/frontend/sugared_value.h: In member function ‘virtual std::shared_ptr torch::ji…
-
I installed the libtorch and put it into the same directory as src. Also converted the pytorch model into jit model. Now I am trying to compile the source code but it gives me an
STrack.h:13:10: fata…
-
Hi,
I am trying to compile the code but I am getting error for #include .
Specifically at::impl::VmapMode has not been declared.
Which version of libtroch are you using? I am using libtorch-cxx11-a…
-
### Xmake 版本
v2.9.4+HEAD.e85b001f1
### 操作系统版本和架构
Windows 11 22631.4112
### 描述问题
libtorch开启cuda和openmp选项，安装libtorch本体成功后提示缺失cuda库
### 期待的结果
xrepo中补全CUDA库，或修改libtorch安装脚本，使得xmake能够在windows上面安装cud…
-
### Your current environment
cuda-12.2
torch-2.3.1
vllm-0.5.3.post1
### 🐛 Describe the bug
[rank1]:[E ProcessGroupNCCL.cpp:1414] [PG 2 Rank 1] Process group watchdog thread terminated with exce…
-
```
[rank2]:[W1014 03:47:39.789025589 socket.cpp:428] [c10d] While waitForInput, poolFD failed with (errno: 0 - Success). | 1061/13485 [09:20
-
Hi
NCCL version: v2.21.5
when I set NCCL_P2P_USE_CUDA_MEMCPY=1，train a resnet model using pytorch with two GPUs in same NUMA， NCCL will hung，pytorch timeout crash
pytorch error：
`[rank1]:[E Proces…