yunicz
commented
7 years ago change the learning rates, lower them
Open vevi1982 opened 7 years ago
yunicz
commented
7 years ago change the learning rates, lower them
I compile ur code use vs2015 ,windows10. and it success. but when i run the q-learning example(learn_scenario_image) in release mode. it interrupt at ' VIRTUAL void GpuOp::apply2_inplace(int N, CLWrapperdestinationWrapper, float scalar, Op2 op) ' cl->finish() statements. i'm fresh in deeplearning. so i do not know why. and this is all my console output messge: `....X ..... ..O.. ..... ..... cl/per_element_add.cl build log: fcl build 1 succeeded. bcl build succeeded.
cl/copy.cl build log: fcl build 1 succeeded. bcl build succeeded.
cl/activate.cl build log: fcl build 1 succeeded. bcl build succeeded.
cl/applyActivationDeriv.cl build log: fcl build 1 succeeded. bcl build succeeded.
cl/activate.cl build log: fcl build 1 succeeded. bcl build succeeded.
cl/applyActivationDeriv.cl build log: fcl build 1 succeeded. bcl build succeeded.
cl/activate.cl build log: fcl build 1 succeeded. bcl build succeeded.
cl/applyActivationDeriv.cl build log: fcl build 1 succeeded. bcl build succeeded.
layer 0:InputLayer{ outputPlanes=2 outputSize=5 } layer 1:ConvolutionalLayer{ LayerDimensions{ inputPlanes=2 inputSize=5 numFilters=8 filterSize=5 outputSize=5 padZeros=1 biased=1 skip=0} } layer 2:ActivationLayer{ RELU } layer 3:ConvolutionalLayer{ LayerDimensions{ inputPlanes=8 inputSize=5 numFilters=8 filterSize=5 outputSize=5 padZeros=1 biased=1 skip=0} } layer 4:ActivationLayer{ RELU } layer 5:FullyConnectedLayer{ numPlanes=100 imageSize=1 } layer 6:ActivationLayer{ TANH } layer 7:FullyConnectedLayer{ numPlanes=4 imageSize=1 } layer 8:SquareLossLayer{} Parameters overview: (skipping 5 layers with 0 params) layer 1: params=408 1.8% layer 3: params=1608 7.1% layer 5: params=20100 89.3% layer 7: params=404 1.8% TOTAL : params=22520 statefultimer v0.7 forward try kernel 0 ... not plausibly optimal, skipping forward try kernel 1 cl/per_element_add.cl build log: fcl build 1 succeeded. bcl build succeeded.
cl/forward1.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid ForwardAuto: kernel 1 4ms forward try kernel 0 ... not plausibly optimal, skipping forward try kernel 1 cl/forward1.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid ForwardAuto: kernel 1 1ms forward try kernel 0 ... not plausibly optimal, skipping forward try kernel 1 cl/forward1.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid ForwardAuto: kernel 1 1ms forward try kernel 0 ... not plausibly optimal, skipping forward try kernel 1 cl/forward1.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid ForwardAuto: kernel 1 1ms forward try kernel 2 cl/forward2.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid ForwardAuto: kernel 2 1ms forward try kernel 2 cl/forward2.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid ForwardAuto: kernel 2 1ms forward try kernel 2 cl/forward2.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid ForwardAuto: kernel 2 1ms forward try kernel 2 cl/forward2.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid ForwardAuto: kernel 2 0ms forward layer selected kernel with zero time2 forward try kernel 3 cl/forward3.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid ForwardAuto: kernel 3 2ms forward try kernel 3 cl/forward3.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid ForwardAuto: kernel 3 1ms forward try kernel 3 cl/forward3.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid ForwardAuto: kernel 3 1ms backward try kernel 0 ... not plausibly optimal, skipping backward try kernel 1 cl/backward.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid BackwardAuto: kernel 1 0ms backward layer selected kernel with zero time1 calcGradWeights try kernel 0 ... not plausibly optimal, skipping calcGradWeights try kernel 1 cl/backpropweights.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid BackpropWeightsAuto: kernel 1 0ms calcGradWeights layer selected kernel with zero time1 backward try kernel 0 ... not plausibly optimal, skipping backward try kernel 1 cl/backward.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid BackwardAuto: kernel 1 1ms calcGradWeights try kernel 0 ... not plausibly optimal, skipping calcGradWeights try kernel 1 cl/backpropweights.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid BackpropWeightsAuto: kernel 1 0ms calcGradWeights layer selected kernel with zero time1 backward try kernel 0 ... not plausibly optimal, skipping backward try kernel 1 cl/backward.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid BackwardAuto: kernel 1 1ms calcGradWeights try kernel 0 ... not plausibly optimal, skipping calcGradWeights try kernel 1 cl/backpropweights.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid BackpropWeightsAuto: kernel 1 1ms calcGradWeights try kernel 0 ... not plausibly optimal, skipping calcGradWeights try kernel 1 cl/backpropweights.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid BackpropWeightsAuto: kernel 1 0ms calcGradWeights layer selected kernel with zero time1 cl/per_element_op2_scalar.cl build log: fcl build 1 succeeded. bcl build succeeded.
cl/per_element_op2.cl build log: fcl build 1 succeeded. bcl build succeeded.
cl/per_element_op2.cl build log: fcl build 1 succeeded. bcl build succeeded.
forward try kernel 4 cl/forward4.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid ForwardAuto: kernel 4 1ms forward try kernel 4 cl/forward4.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid ForwardAuto: kernel 4 1ms forward try kernel 4 cl/forward4.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid ForwardAuto: kernel 4 1ms forward try kernel 5 ForwardAuto: kernel 5: this instance cant be used: For ForwardFc, padzeros must be disabled ... not valid forward try kernel 6 cl/forward_byinputplane.cl build log: fcl build 1 succeeded. bcl build succeeded.
cl/reduce_segments.cl build log: fcl build 1 succeeded. bcl build succeeded.
cl/per_element_add.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid ForwardAuto: kernel 6 2ms forward try kernel 5 ForwardAuto: kernel 5: this instance cant be used: For ForwardFc, padzeros must be disabled ... not valid forward try kernel 6 cl/forward_byinputplane.cl build log: fcl build 1 succeeded. bcl build succeeded.
cl/reduce_segments.cl build log: fcl build 1 succeeded. bcl build succeeded.
cl/per_element_add.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid ForwardAuto: kernel 6 1ms forward try kernel 5 cl/reduce_segments.cl build log: fcl build 1 succeeded. bcl build succeeded.
cl/forward_fc_wgperrow.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid ForwardAuto: kernel 5 2ms forward try kernel 7 ... seems valid ForwardIm2Col.cl build log: fcl build 1 succeeded. bcl build succeeded.
ForwardAuto: kernel 7 this instance cant be used: clblasSgemm() failed with -1023 forward kernel 0: cannot be used forward kernel 1 time: 4ms forward kernel 2 time: 1ms forward kernel 3 time: 2ms forward kernel 4 time: 1ms forward kernel 5: cannot be used forward kernel 6 time: 2ms forward kernel 7: cannot be used forward layer selected kernel 2 forward try kernel 7 ... seems valid ForwardIm2Col.cl build log: fcl build 1 succeeded. bcl build succeeded.
ForwardAuto: kernel 7 this instance cant be used: clblasSgemm() failed with -1023 forward kernel 0: cannot be used forward kernel 1 time: 1ms forward kernel 2 time: 1ms forward kernel 3 time: 1ms forward kernel 4 time: 1ms forward kernel 5: cannot be used forward kernel 6 time: 1ms forward kernel 7: cannot be used forward layer selected kernel 1 forward try kernel 6 cl/forward_byinputplane.cl build log: fcl build 1 succeeded. bcl build succeeded.
cl/reduce_segments.cl build log: fcl build 1 succeeded. bcl build succeeded.
cl/per_element_add.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid ForwardAuto: kernel 6 2ms forward try kernel 7 ... seems valid ForwardIm2Col.cl build log: fcl build 1 succeeded. bcl build succeeded.
ForwardAuto: kernel 7 this instance cant be used: clblasSgemm() failed with -1023 forward kernel 0: cannot be used forward kernel 1 time: 1ms forward kernel 2 time: 1ms forward kernel 3 time: 1ms forward kernel 4 time: 1ms forward kernel 5 time: 2ms forward kernel 6 time: 2ms forward kernel 7: cannot be used forward layer selected kernel 1 backward try kernel 2 cl/backward_cached.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid BackwardAuto: kernel 2 1ms backward try kernel 2 cl/backward_cached.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid BackwardAuto: kernel 2 0ms backward layer selected kernel with zero time2 calcGradWeights try kernel 2 cl/BackpropWeightsScratch.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid BackpropWeightsAuto: kernel 2 1ms backward try kernel 3 ... seems valid BackwardAuto: kernel 3 this instance cant be used: clblasSgemm() failed with -1023 backward kernel 0: cannot be used backward kernel 1 time: 1ms backward kernel 2 time: 1ms backward kernel 3: cannot be used backward layer selected kernel 1 calcGradWeights try kernel 3 options: -D BIASED -D gNumInputPlanes=8 -D gInputPlanes=8 -D gInputSize=5 -D gInputSizeSquared=25 -D gNumFilters=8 -D gFilterSize=5 -D gHalfFilterSize=2 -D gFilterSizeSquared=25 -D gNumOutputPlanes=8 -D gOutputPlanes=8 -D gOutputSize=5 -D gOutputSizeSquared=25 -D gPadZeros=1 -D gMargin=2 -D gEven=0 -D gSkip=0 -DgNumStripes=1 -DgInputStripeMarginRows=4 -DgInputStripeInnerNumRows=5 -DgInputStripeOuterNumRows=13 -DgInputStripeInnerSize=25 -DgInputStripeOuterSize=65 -DgInputStripeMarginSize=20 -DgOutputStripeNumRows=5 -DgOutputStripeSize=25 cl/BackpropWeightsScratchLarge.cl build log: fcl build 1 succeeded. bcl build succeeded.
... seems valid BackpropWeightsAuto: kernel 3 0ms calcGradWeights layer selected kernel with zero time3 ..... ..... ..X.. ..... ..... q directions: VV<VV VVVVV VVVVV VVVVV VVVVV game: 1 moves: 16 ..... ....X ..... ..... ..... q directions: VVVVV VVVVV VVVVV VVVVV VVVVV game: 2 moves: 1 ..... ..... ..... ...X. ..... q directions: