search

kerlomz / captcha_trainer

[验证码识别-训练] This project is based on CNN/ResNet/DenseNet+GRU/LSTM+CTC/CrossEntropy to realize verification code identification. This project is only for training the model.
Apache License 2.0
3.02k stars 821 forks source link

每隔500次训练,内存占用突增 #10

Closed asjdf closed 5 years ago

asjdf commented 5 years ago

每隔500次系统卡顿一次,采用cpu训练

2019-04-05 16:54:36.524458: W tensorflow/core/framework/allocator.cc:124] Allocation of 614400000 exceeds 10% of system memory. 2019-04-05 16:55:43.043568: W tensorflow/core/framework/allocator.cc:124] Allocation of 614400000 exceeds 10% of system memory. 2019-04-05 16:55:50.748391: W tensorflow/core/framework/allocator.cc:124] Allocation of 614400000 exceeds 10% of system memory. 0 4 4 [1, 5, 2, 2] [1, 5, 2, 2] 1 4 4 [5, 6, 4, 5] [5, 6, 4, 5] 2 4 4 [9, 9, 10, 7] [9, 9, 10, 7] 3 4 4 [6, 2, 4, 1] [6, 2, 4, 1] 4 4 4 [1, 6, 10, 2] [1, 6, 10, 2] Epoch: 3, Step: 1500, Accuracy = 0.973, Cost = 0.1232, Time = 89.143, LearningRate: 0.009999999776482582, LastBatchError: 0.006666666828095913

asjdf commented 5 years ago

8g内存

asjdf commented 5 years ago

好像明白为什么内存占用暴增了 在测试准确率 然后用demo的检测量300太大了