search

manuelruder / artistic-videos

Torch implementation for the paper "Artistic style transfer for videos"
Other
1.75k stars 252 forks source link

Issue with some frames crashing after 2 iterations #52

Open TommyKnow opened 7 years ago

TommyKnow commented 7 years ago

Hi all,

Apologies if this was fixed elsewhere, but I cannot find it if so. I'm a noob to this type of software and it's a little bewildering.

Some frames (very often the first frame, but usually around 1 in 15 of completed frames) will crash after only going for one or two iterations. The result is that the frame is blurry compared to the ones that completed without issue. The script then carries on and attempts to create the next frame.

No obvious error, but there is a difference between frames which did and didn't crash (in bold):

Reading flow file ".../wavelarge/flow_1280:720/backward_19_18.flo". Reading flowWeights file ".../wavelarge/flow_1280:720/reliable_19_18.pgm".
Reading flow file ".../wavelarge/flow_1280:720/backward_19_18.flo". Running optimization with L-BFGS

creating recyclable direction/step/history buffers **function value changing less than tolX** Running time: 1s Iteration 2 / 300 Content 1 loss: 9200722.500000 Temporal 1 loss: **0.000000** Style 1 loss: 812805.512238 Style 2 loss: 266905000.195312 Style 3 loss: 722221992.968750 Style 4 loss: 21909036787.500000 Style 5 loss: 1525010.723877 Total loss: 22909702319.400177 Reading flow file I've tried setting -tol_loss_relative to 0 but that doesn't change anything. It has also been suggested that lowering the style weight might help but it still occurs with it lowered significantly. Any ideas?
ChoclateRain commented 7 years ago

@TommyKnow Removing -temporal_weight fixes it for me (you'll just have to use the default temp weight for those frames that are crashing, and make sure not to even enter the default -temporal_weight just run without setting that param)