Hi Manuel! First of all, I would like to express my admiration to you and this wonderful aplication. I come from Spain and studied one year with an Erasmus in Karlsruhe, so it is pretty cool to see that all these new utilities are being developed so near from where I lived! I have also seen the paper from "Leon" from Tübingen.
So, I succesfully runned the jcjohnson program in Ubuntu. I am using the computing capabilities of my university to run the codes way faster. However, when trying your approach for videos, I get this error and I am not very sure about how to solve it. I am not a computer science guy so my knowledge about Linux is pretty much what I discovered through trial and error trying to get the jcjohnson code working. I am not sure if I understood well the installation process. First, I clicked the "clone and download" button in github (the guys from my university told me not to use sudo commands, and for the jcjohnson, the git clone steps used them, so I didn't want to risk). I uncompressed it and placed the folder in my work directory. Then, I also uncompressed the deep flow and deep matching folders and placed such folders in the artistic-video folder. As it didn't work, I thought that maybe you meant copying the deepflow-static and deepmatch-static files into the artistic-video folder rather than in their own deepflow and deepmatch folders, but that didn't work either.
I hope you can help me.
Dankeschon!
[antonioa1@wh-520-9-5 avm]$ bash stylizeVideo.sh inputs/f.mov model/1.jpg
Which backend do you want to use? For Nvidia GPU, use cudnn if available, otherwise nn. For non-Nvidia GPU, use clnn. Note: You have to have the given backend installed in order to use it. [nn]
> cudm^[[D^[[3~^[^[^[^[^[^[^[[D^[[D^[[Ccudnn
Unknown backend.
[antonioa1@wh-520-9-5 avm]$ cudnn
bash: cudnn: command not found
[antonioa1@wh-520-9-5 avm]$ bash stylizeVideo.sh inputs/f.mov model/1.jpg
Which backend do you want to use? For Nvidia GPU, use cudnn if available, otherwise nn. For non-Nvidia GPU, use clnn. Note: You have to have the given backend installed in order to use it. [nn]
> cudnn
This algorithm needs a lot of memory. For a resolution of 450x350 you'll need roughly 2GB VRAM. VRAM usage increases linear with resolution. Please enter a resolution at which the video should be processed, in the format w:h, or leave blank to use the original resolution
> 450x350
ffmpeg version 2.8.5 Copyright (c) 2000-2016 the FFmpeg developers
built with gcc 4.4.7 (GCC) 20120313 (Red Hat 4.4.7-4)
configuration: --prefix=/apps/ffmpeg/2.8.5 --enable-gpl --enable-postproc --enable-version3 --enable-x11grab --enable-shared
libavutil 54. 31.100 / 54. 31.100
libavcodec 56. 60.100 / 56. 60.100
libavformat 56. 40.101 / 56. 40.101
libavdevice 56. 4.100 / 56. 4.100
libavfilter 5. 40.101 / 5. 40.101
libswscale 3. 1.101 / 3. 1.101
libswresample 1. 2.101 / 1. 2.101
libpostproc 53. 3.100 / 53. 3.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'inputs/f.mov':
Metadata:
major_brand : qt
minor_version : 0
compatible_brands: qt
creation_time : 2016-09-18 15:13:11
Duration: 00:00:11.67, start: 0.000000, bitrate: 17509 kb/s
Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv, bt709), 1920x1080, 17411 kb/s, 29.98 fps, 29.97 tbr, 600 tbn, 1200 tbc (default)
Metadata:
rotate : 180
creation_time : 2016-09-18 15:13:11
handler_name : Core Media Data Handler
encoder : H.264
Side data:
displaymatrix: rotation of -180.00 degrees
Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, mono, fltp, 90 kb/s (default)
Metadata:
creation_time : 2016-09-18 15:13:11
handler_name : Core Media Data Handler
Stream #0:2(und): Data: none (mebx / 0x7862656D), 0 kb/s (default)
Metadata:
creation_time : 2016-09-18 15:13:11
handler_name : Core Media Data Handler
Stream #0:3(und): Data: none (mebx / 0x7862656D), 0 kb/s (default)
Metadata:
creation_time : 2016-09-18 15:13:11
handler_name : Core Media Data Handler
Output #0, image2, to 'f/frame_%04d.ppm':
Metadata:
major_brand : qt
minor_version : 0
compatible_brands: qt
encoder : Lavf56.40.101
Stream #0:0(und): Video: ppm, rgb24, 450x350, q=2-31, 200 kb/s, 29.97 fps, 29.97 tbn, 29.97 tbc (default)
Metadata:
handler_name : Core Media Data Handler
creation_time : 2016-09-18 15:13:11
encoder : Lavc56.60.100 ppm
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> ppm (native))
Press [q] to stop, [?] for help
frame= 350 fps= 10 q=-0.0 Lsize=N/A time=00:00:11.67 bitrate=N/A
video:161504kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
How much do you want to weight the style reconstruction term? Default value: 1e2 for a resolution of 450x350. Increase for a higher resolution. [1e2]
> 1e2
Enter the zero-indexed ID of the GPU to use, or -1 for CPU mode (very slow!). [0]
> 0
Computing optical flow. This may take a while...
run-deepflow.sh: line 10: ./deepmatching-static: Permission denied
run-deepflow.sh: line 10: ./deepflow2-static: Permission denied
run-deepflow.sh: line 10: ./deepmatching-static: Permission denied
run-deepflow.sh: line 10: ./deepflow2-static: Permission denied
Could not open ./f/flow_450x350/backward_2_1.flo
Could not open ./f/flow_450x350/forward_1_2.flo
Exception EFilterIncompatibleSize: Initial container size: 0 Resulting container size: 0
terminate called after throwing an instance of 'EFilterIncompatibleSize'
makeOptFlow.sh: line 56: 31032 Aborted ./consistencyChecker/consistencyChecker "${folderName}/backward_${j}_${i}.flo" "${folderName}/forward_${i}_${j}.flo" "${folderName}/reliable_${j}_${i}.pgm"
Could not open ./f/flow_450x350/forward_1_2.flo
Could not open ./f/flow_450x350/backward_2_1.flo
Exception EFilterIncompatibleSize: Initial container size: 0 Resulting container size: 0
terminate called after throwing an instance of 'EFilterIncompatibleSize'
makeOptFlow.sh: line 56: 31033 Aborted ./consistencyChecker/consistencyChecker "${folderName}/forward_${i}_${j}.flo" "${folderName}/backward_${j}_${i}.flo" "${folderName}/reliable_${i}_${j}.pgm"
run-deepflow.sh: line 10: ./deepmatching-static: Permission denied
run-deepflow.sh: line 10: ./deepflow2-static: Permission denied
run-deepflow.sh: line 10: ./deepmatching-static: Permission denied
run-deepflow.sh: line 10: ./deepflow2-static: Permission denied
Could not open ./f/flow_450x350/backward_3_2.flo
Could not open ./f/flow_450x350/forward_2_3.flo
Exception EFilterIncompatibleSize: Initial container size: 0 Resulting container size: 0
terminate called after throwing an instance of 'EFilterIncompatibleSize'
makeOptFlow.sh: line 56: 31042 Aborted ./consistencyChecker/consistencyChecker "${folderName}/backward_${j}_${i}.flo" "${folderName}/forward_${i}_${j}.flo" "${folderName}/reliable_${j}_${i}.pgm"
Could not open ./f/flow_450x350/forward_2_3.flo
Could not open ./f/flow_450x350/backward_3_2.flo
Exception EFilterIncompatibleSize: Initial container size: 0 Resulting container size: 0
terminate called after throwing an instance of 'EFilterIncompatibleSize'
makeOptFlow.sh: line 56: 31043 Aborted ./consistencyChecker/consistencyChecker "${folderName}/forward_${i}_${j}.flo" "${folderName}/backward_${j}_${i}.flo" "${folderName}/reliable_${i}_${j}.pgm"
run-deepflow.sh: line 10: ./deepmatching-static: Permission denied
run-deepflow.sh: line 10: ./deepflow2-static: Permission denied
run-deepflow.sh: line 10: ./deepflow2-static: Permission denied
run-deepflow.sh: line 10: ./deepmatching-static: Permission denied
Could not open ./f/flow_450x350/backward_4_3.flo
Could not open ./f/flow_450x350/forward_3_4.flo
Exception EFilterIncompatibleSize: Initial container size: 0 Resulting container size: 0
terminate called after throwing an instance of 'EFilterIncompatibleSize'
makeOptFlow.sh: line 56: 31052 Aborted ./consistencyChecker/consistencyChecker "${folderName}/backward_${j}_${i}.flo" "${folderName}/forward_${i}_${j}.flo" "${folderName}/reliable_${j}_${i}.pgm"
Could not open ./f/flow_450x350/forward_3_4.flo
Could not open ./f/flow_450x350/backward_4_3.flo
Exception EFilterIncompatibleSize: Initial container size: 0 Resulting container size: 0
terminate called after throwing an instance of 'EFilterIncompatibleSize'
makeOptFlow.sh: line 56: 31053 Aborted ./consistencyChecker/consistencyChecker "${folderName}/forward_${i}_${j}.flo" "${folderName}/backward_${j}_${i}.flo" "${folderName}/reliable_${i}_${j}.pgm"
run-deepflow.sh: line 10: ./deepmatching-static: Permission denied
run-deepflow.sh: line 10: ./deepflow2-static: Permission denied
run-deepflow.sh: line 10: ./deepmatching-static: Permission denied
run-deepflow.sh: line 10: ./deepflow2-static: Permission denied
Could not open ./f/flow_450x350/backward_5_4.flo
Could not open ./f/flow_450x350/forward_4_5.flo
Exception EFilterIncompatibleSize: Initial container size: 0 Resulting container size: 0
terminate called after throwing an instance of 'EFilterIncompatibleSize'
makeOptFlow.sh: line 56: 31062 Aborted ./consistencyChecker/consistencyChecker "${folderName}/backward_${j}_${i}.flo" "${folderName}/forward_${i}_${j}.flo" "${folderName}/reliable_${j}_${i}.pgm"
Could not open ./f/flow_450x350/forward_4_5.flo
Could not open ./f/flow_450x350/backward_5_4.flo
Exception EFilterIncompatibleSize: Initial container size: 0 Resulting container size: 0
terminate called after throwing an instance of 'EFilterIncompatibleSize'
makeOptFlow.sh: line 56: 31063 Aborted ./consistencyChecker/consistencyChecker "${folderName}/forward_${i}_${j}.flo" "${folderName}/backward_${j}_${i}.flo" "${folderName}/reliable_${i}_${j}.pgm"
run-deepflow.sh: line 10: ./deepmatching-static: Permission denied
run-deepflow.sh: line 10: ./deepflow2-static: Permission denied
run-deepflow.sh: line 10: ./deepflow2-static: Permission denied
run-deepflow.sh: line 10: ./deepmatching-static: Permission denied
Could not open ./f/flow_450x350/backward_6_5.flo
Could not open ./f/flow_450x350/forward_5_6.flo
Exception EFilterIncompatibleSize: Initial container size: 0 Resulting container size: 0
terminate called after throwing an instance of 'EFilterIncompatibleSize'
makeOptFlow.sh: line 56: 31072 Aborted ./consistencyChecker/consistencyChecker "${folderName}/backward_${j}_${i}.flo" "${folderName}/forward_${i}_${j}.flo" "${folderName}/reliable_${j}_${i}.pgm"
Could not open ./f/flow_450x350/forward_5_6.flo
Could not open ./f/flow_450x350/backward_6_5.flo
Exception EFilterIncompatibleSize: Initial container size: 0 Resulting container size: 0
terminate called after throwing an instance of 'EFilterIncompatibleSize'
makeOptFlow.sh: line 56: 31073 Aborted ./consistencyChecker/consistencyChecker "${folderName}/forward_${i}_${j}.flo" "${folderName}/backward_${j}_${i}.flo" "${folderName}/reliable_${i}_${j}.pgm"
run-deepflow.sh: line 10: ./deepmatching-static: Permission denied
run-deepflow.sh: line 10: ./deepflow2-static: Permission denied
run-deepflow.sh: line 10: ./deepmatching-static: Permission denied
run-deepflow.sh: line 10: ./deepflow2-static: Permission denied
Could not open ./f/flow_450x350/backward_7_6.flo
Could not open ./f/flow_450x350/forward_6_7.flo
Exception EFilterIncompatibleSize: Initial container size: 0 Resulting container size: 0
terminate called after throwing an instance of 'EFilterIncompatibleSize'
makeOptFlow.sh: line 56: 31082 Aborted ./consistencyChecker/consistencyChecker "${folderName}/backward_${j}_${i}.flo" "${folderName}/forward_${i}_${j}.flo" "${folderName}/reliable_${j}_${i}.pgm"
Could not open ./f/flow_450x350/forward_6_7.flo
Could not open ./f/flow_450x350/backward_7_6.flo
Exception EFilterIncompatibleSize: Initial container size: 0 Resulting container size: 0
terminate called after throwing an instance of 'EFilterIncompatibleSize'
makeOptFlow.sh: line 56: 31083 Aborted ./consistencyChecker/consistencyChecker "${folderName}/forward_${i}_${j}.flo" "${folderName}/backward_${j}_${i}.flo" "${folderName}/reliable_${i}_${j}.pgm"
run-deepflow.sh: line 10: ./deepmatching-static: Permission denied
run-deepflow.sh: line 10: ./deepflow2-static: Permission denied
run-deepflow.sh: line 10: ./deepmatching-static: Permission denied
run-deepflow.sh: line 10: ./deepflow2-static: Permission denied
Could not open ./f/flow_450x350/backward_8_7.flo
Could not open ./f/flow_450x350/forward_7_8.flo
Exception EFilterIncompatibleSize: Initial container size: 0 Resulting container size: 0
terminate called after throwing an instance of 'EFilterIncompatibleSize'
makeOptFlow.sh: line 56: 31092 Aborted ./consistencyChecker/consistencyChecker "${folderName}/backward_${j}_${i}.flo" "${folderName}/forward_${i}_${j}.flo" "${folderName}/reliable_${j}_${i}.pgm"
Could not open ./f/flow_450x350/forward_7_8.flo
Could not open ./f/flow_450x350/backward_8_7.flo
Exception EFilterIncompatibleSize: Initial container size: 0 Resulting container size: 0
terminate called after throwing an instance of 'EFilterIncompatibleSize'
makeOptFlow.sh: line 56: 31093 Aborted ./consistencyChecker/consistencyChecker "${folderName}/forward_${i}_${j}.flo" "${folderName}/backward_${j}_${i}.flo" "${folderName}/reliable_${i}_${j}.pgm"
run-deepflow.sh: line 10: ./deepmatching-static: Permission denied
run-deepflow.sh: line 10: ./deepflow2-static: Permission denied
run-deepflow.sh: line 10: ./deepmatching-static: Permission denied
run-deepflow.sh: line 10: ./deepflow2-static: Permission denied
Could not open ./f/flow_450x350/backward_9_8.flo
Could not open ./f/flow_450x350/forward_8_9.flo
Exception EFilterIncompatibleSize: Initial container size: 0 Resulting container size: 0
terminate called after throwing an instance of 'EFilterIncompatibleSize'
makeOptFlow.sh: line 56: 31102 Aborted ./consistencyChecker/consistencyChecker "${folderName}/backward_${j}_${i}.flo" "${folderName}/forward_${i}_${j}.flo" "${folderName}/reliable_${j}_${i}.pgm"
Could not open ./f/flow_450x350/forward_8_9.flo
Could not open ./f/flow_450x350/backward_9_8.flo
Exception EFilterIncompatibleSize: Initial container size: 0 Resulting container size: 0
terminate called after throwing an instance of 'EFilterIncompatibleSize'
makeOptFlow.sh: line 56: 31103 Aborted ./consistencyChecker/consistencyChecker "${folderName}/forward_${i}_${j}.flo" "${folderName}/backward_${j}_${i}.flo" "${folderName}/reliable_${i}_${j}.pgm"
Hi Manuel! First of all, I would like to express my admiration to you and this wonderful aplication. I come from Spain and studied one year with an Erasmus in Karlsruhe, so it is pretty cool to see that all these new utilities are being developed so near from where I lived! I have also seen the paper from "Leon" from Tübingen.
So, I succesfully runned the jcjohnson program in Ubuntu. I am using the computing capabilities of my university to run the codes way faster. However, when trying your approach for videos, I get this error and I am not very sure about how to solve it. I am not a computer science guy so my knowledge about Linux is pretty much what I discovered through trial and error trying to get the jcjohnson code working. I am not sure if I understood well the installation process. First, I clicked the "clone and download" button in github (the guys from my university told me not to use sudo commands, and for the jcjohnson, the git clone steps used them, so I didn't want to risk). I uncompressed it and placed the folder in my work directory. Then, I also uncompressed the deep flow and deep matching folders and placed such folders in the artistic-video folder. As it didn't work, I thought that maybe you meant copying the deepflow-static and deepmatch-static files into the artistic-video folder rather than in their own deepflow and deepmatch folders, but that didn't work either.
I hope you can help me. Dankeschon!