foamliu / Car-Recognition

Car Recognition with Deep Learning
MIT License
345 stars 135 forks source link

OutOfMemory issue on Jetson Nano #24

Open suresh-s opened 4 years ago

suresh-s commented 4 years ago

I am exploring the Car-Recognition code and started executed on Jetson Nano. I got following error when i execute train.py even though i have reduced batch_size to 2 from 16.

Could you help me to resolve this issue?

`2020-07-30 01:09:20.116067: I tensorflow/core/common_runtime/bfc_allocator.cc:923] total_region_allocatedbytes: 226148352 memorylimit: 226148352 available bytes: 0 curr_region_allocationbytes: 452296704 2020-07-30 01:09:20.116101: I tensorflow/core/common_runtime/bfc_allocator.cc:929] Stats: Limit: 226148352 InUse: 226148352 MaxInUse: 226148352 NumAllocs: 1090 MaxAllocSize: 9437184

2020-07-30 01:09:20.116188: W tensorflow/core/common_runtime/bfc_allocator.cc:424] ***x 2020-07-30 01:09:20.116269: W tensorflow/core/framework/op_kernel.cc:1651] OP_REQUIRES failed at assign_op.h:117 : Resource exhausted: OOM when allocating tensor with shape[512] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc

thank you, `

Usman-Ghani123 commented 4 years ago

Are you working on jupyter notebook?