Open Tramac opened 5 months ago
same error
same error
how to solve this problem?
+1
I try to debug it and this error will happen when it tryS to copy tensor from CPU to GPU
I also encountered the same issue...
I also encountered the same issue...
workaround solution: python3 main.py --disable-cuda-malloc
I encountered this issue after upgrading to torch 2.0. CUDA is still 11.3, and the GPU is 2080. when reverting to torch 1.13, it works fine, but ipadater doesn’t work because it depends on torchvision.v2.transformer.
add '--disable-cuda-malloc' work also. but what side effects will this have? will it affect inference performance?”
start server:
python3 main.py --listen
nvcc -V