search

linksense / LightNetPlusPlus

LightNet++: Boosted Light-weighted Networks for Real-time Semantic Segmentation
https://ansleliu.github.io/LightNet.html
MIT License
243 stars 54 forks source link

"RuntimeError: CUDA out of memory." #7

Closed IOEvan closed 4 years ago

IOEvan commented 4 years ago

Thanks for your job!!! I got this error when using "train_shuffle.py" to train model on citysacpes dataset

Traceback (most recent call last):    
  File "/home/wcgu/code/RTSeg/LightNetPlusPlus/scripts/train_shuffle.py", line 382, in <module>    
    train(train_args, data_path, save_path)    
  File "/home/wcgu/code/RTSeg/LightNetPlusPlus/scripts/train_shuffle.py", line 290, in train    
    val_loss = loss_fn(input=net_out, target=labels_val, K=topk, weight=None)    
  File "/home/wcgu/code/RTSeg/LightNetPlusPlus/scripts/loss.py", line 111, in bootstrapped_cross_entropy2d    
    size_average=size_average)    
  File "/home/wcgu/code/RTSeg/LightNetPlusPlus/scripts/loss.py", line 88, in _bootstrap_xentropy_single    
    log_p = log_p[target.view(n * h * w, 1).repeat(1, c) >= 0]   
RuntimeError: CUDA out of memory. Tried to allocate 304.00 MiB (GPU 0; 10.72 GiB total capacity; 9.30 GiB already allocated; 226.62 MiB free; 59.54 MiB cached)

The batch_size is 1, and the training step is ok. Could you help me to solve it?

zhanghaobucunzai commented 2 years ago

请问下，训练脚本在哪啊？