search

karpathy / char-rnn

Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch
11.52k stars 2.58k forks source link

GPU memory is not free when program exits... #194

Open danindiana opened 7 years ago

danindiana commented 7 years ago

GPU memory is not free when program exits.

THCudaCheck FAIL file=/home/speed/torch/extra/cutorch/lib/THC/generic/THCStorage.cu line=66 error=2 : out of memory /home/speed/torch/install/bin/luajit: /home/speed/torch/install/share/lua/5.1/nn/CAddTable.lua:13: cuda runtime error (2) : out of memory at /home/speed/torch/extra/cutorch/lib/THC/generic/THCStorage.cu:66 stack traceback: [C]: in function 'resizeAs' /home/speed/torch/install/share/lua/5.1/nn/CAddTable.lua:13: in function 'func' /home/speed/torch/install/share/lua/5.1/nngraph/gmodule.lua:345: in function 'neteval' /home/speed/torch/install/share/lua/5.1/nngraph/gmodule.lua:380: in function 'forward' train.lua:270: in function 'opfunc' /home/speed/torch/install/share/lua/5.1/optim/rmsprop.lua:35: in function 'rmsprop' train.lua:314: in main chunk [C]: in function 'dofile' ...peed/torch/install/lib/luarocks/rocks/trepl/scm-1/bin/th:150: in main chunk [C]: at 0x00405e40

+-----------------------------------------------------------------------------+ | NVIDIA-SMI 375.51 Driver Version: 375.51 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | |===============================+======================+======================| | 0 GeForce GTX 750 Ti On | 0000:04:00.0 On | N/A | | 42% 35C P0 2W / 52W | 1620MiB / 2000MiB | 0% Default | +-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+ | Processes: GPU Memory | | GPU PID Type Process name Usage | |=============================================================================| | 0 1293 G /usr/bin/X 101MiB | | 0 2516 G /usr/bin/gnome-shell 67MiB | | 0 3764 C /home/speed/torch/install/bin/luajit 584MiB | | 0 3773 C /home/speed/torch/install/bin/luajit 820MiB | | 0 3885 G ...el-token=C58E1E145621B2C8C7F223AF9B046CA2 42MiB | +-----------------------------------------------------------------------------+