search

JamBrain / JamBrain

The software powering Ludum Dare game jam events
https://ldjam.com
MIT License
487 stars 80 forks source link

Static Server: Setup and Configure #131

Closed mikekasprzak closed 6 years ago

mikekasprzak commented 8 years ago

The static file hosting server will be a separate machine, since we can get more storage cheaper this way.

Probably a Paris server, with 150 GB attachment (fire and forget), wrapped behind CloudFlare.

mikekasprzak commented 7 years ago

Scaleway added Amsterdam servers, but after benchmarking them, Paris was still faster (to both me and New York).

mikekasprzak commented 7 years ago

Need to address this. We're not going to have enough hard drive space for the images come Ludum Dare 39.

mikekasprzak commented 7 years ago

Need to perform some benchmarks.

mikekasprzak commented 7 years ago

VOIR: Scaleway Intel Atom Xeon (VC1S), VPS 2 Core, 2 GB RAM, Ubuntu 16.04

time ./to_mp4.sh rudebear.webm
ffmpeg version 2.8.11-0ubuntu0.16.04.1 Copyright (c) 2000-2017 the FFmpeg developers
  built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.4) 20160609
  configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
  libavutil      54. 31.100 / 54. 31.100
  libavcodec     56. 60.100 / 56. 60.100
  libavformat    56. 40.101 / 56. 40.101
  libavdevice    56.  4.100 / 56.  4.100
  libavfilter     5. 40.101 /  5. 40.101
  libavresample   2.  1.  0 /  2.  1.  0
  libswscale      3.  1.101 /  3.  1.101
  libswresample   1.  2.101 /  1.  2.101
  libpostproc    53.  3.100 / 53.  3.100
Input #0, matroska,webm, from 'rudebear.webm':
  Metadata:
    encoder         : Lavf56.25.101
  Duration: 00:00:53.55, start: 0.000000, bitrate: 5718 kb/s
    Stream #0:0(eng): Video: vp8, yuv420p, 1920x1080, SAR 1:1 DAR 16:9, 60 fps, 60 tbr, 1k tbn, 1k tbc (default)
    Stream #0:1(eng): Audio: vorbis, 48000 Hz, stereo, fltp (default)
[libx264 @ 0x6acc60] using SAR=1/1
[libx264 @ 0x6acc60] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2
[libx264 @ 0x6acc60] profile High, level 4.2
[libx264 @ 0x6acc60] 264 - core 148 r2643 5c65704 - H.264/MPEG-4 AVC codec - Copyleft 2003-2015 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=3 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to 'rudebear.webm.mp4':
  Metadata:
    encoder         : Lavf56.40.101
    Stream #0:0(eng): Video: h264 (libx264) ([33][0][0][0] / 0x0021), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], q=-1--1, 60 fps, 15360 tbn, 60 tbc (default)
    Metadata:
      encoder         : Lavc56.60.100 libx264
    Stream #0:1(eng): Audio: aac ([64][0][0][0] / 0x0040), 48000 Hz, stereo, fltp, 128 kb/s (default)
    Metadata:
      encoder         : Lavc56.60.100 aac
Stream mapping:
  Stream #0:0 -> #0:0 (vp8 (native) -> h264 (libx264))
  Stream #0:1 -> #0:1 (vorbis (native) -> aac (native))
Press [q] to stop, [?] for help
frame= 3211 fps=4.3 q=-1.0 Lsize=   50205kB time=00:00:53.57 bitrate=7677.3kbits/s dup=1 drop=0    
video:49236kB audio:890kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.156356%
bench: utime=1440.350s
bench: maxrss=472204kB
[libx264 @ 0x6acc60] frame I:33    Avg QP:20.85  size:106883
[libx264 @ 0x6acc60] frame P:1824  Avg QP:26.34  size: 22332
[libx264 @ 0x6acc60] frame B:1354  Avg QP:27.88  size:  4547
[libx264 @ 0x6acc60] consecutive B-frames: 34.9% 22.1% 13.7% 29.3%
[libx264 @ 0x6acc60] mb I  I16..4: 23.8% 42.8% 33.4%
[libx264 @ 0x6acc60] mb P  I16..4:  4.4%  5.4%  1.4%  P16..4: 35.6%  6.2%  2.7%  0.0%  0.0%    skip:44.4%
[libx264 @ 0x6acc60] mb B  I16..4:  0.4%  0.3%  0.1%  B16..8: 24.1%  1.4%  0.2%  direct: 0.5%  skip:73.0%  L0:52.1% L1:45.2% BI: 2.8%
[libx264 @ 0x6acc60] 8x8 transform intra:47.2% inter:70.1%
[libx264 @ 0x6acc60] coded y,uvDC,uvAC intra: 33.4% 46.0% 13.8% inter: 10.6% 7.9% 0.4%
[libx264 @ 0x6acc60] i16 v,h,dc,p: 30% 33% 21% 15%
[libx264 @ 0x6acc60] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 28% 21% 30%  3%  3%  4%  4%  3%  4%
[libx264 @ 0x6acc60] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 29% 26% 16%  4%  5%  6%  5%  4%  4%
[libx264 @ 0x6acc60] i8c dc,h,v,p: 57% 22% 16%  5%
[libx264 @ 0x6acc60] Weighted P-Frames: Y:10.7% UV:4.2%
[libx264 @ 0x6acc60] ref P L0: 62.0% 24.0% 10.3%  3.4%  0.3%
[libx264 @ 0x6acc60] ref B L0: 90.4%  8.6%  1.0%
[libx264 @ 0x6acc60] ref B L1: 96.5%  3.5%
[libx264 @ 0x6acc60] kb/s:7536.67

real    12m21.665s
user    24m0.450s
sys 0m2.530s
mikekasprzak commented 7 years ago

LUDUMDARE: Scaleway Intel Atom Xeon (C2L), Dedicated 8 core, 32 GB RAM, Ubuntu 14.04

udumdare:~# time ./to_mp4.sh rudebear.webm 
ffmpeg version 3.3.1 Copyright (c) 2000-2017 the FFmpeg developers
  built with gcc 4.8 (Ubuntu 4.8.4-2ubuntu1~14.04.3)
  configuration: --extra-libs=-ldl --prefix=/opt/ffmpeg --mandir=/usr/share/man --enable-avresample --disable-debug --enable-nonfree --enable-gpl --enable-version3 --enable-libopencore-amrnb --enable-libopencore-amrwb --disable-decoder=amrnb --disable-decoder=amrwb --enable-libpulse --enable-libfreetype --enable-gnutls --enable-libx264 --enable-libx265 --enable-libfdk-aac --enable-libvorbis --enable-libmp3lame --enable-libopus --enable-libvpx --enable-libspeex --enable-libass --enable-avisynth --enable-libsoxr --enable-libxvid --enable-libvidstab --enable-libwavpack --enable-nvenc
  libavutil      55. 58.100 / 55. 58.100
  libavcodec     57. 89.100 / 57. 89.100
  libavformat    57. 71.100 / 57. 71.100
  libavdevice    57.  6.100 / 57.  6.100
  libavfilter     6. 82.100 /  6. 82.100
  libavresample   3.  5.  0 /  3.  5.  0
  libswscale      4.  6.100 /  4.  6.100
  libswresample   2.  7.100 /  2.  7.100
  libpostproc    54.  5.100 / 54.  5.100
Input #0, matroska,webm, from 'rudebear.webm':
  Metadata:
    encoder         : Lavf56.25.101
  Duration: 00:00:53.55, start: 0.000000, bitrate: 5718 kb/s
    Stream #0:0(eng): Video: vp8, yuv420p(progressive), 1920x1080, SAR 1:1 DAR 16:9, 60 fps, 60 tbr, 1k tbn, 1k tbc (default)
    Stream #0:1(eng): Audio: vorbis, 48000 Hz, stereo, fltp (default)
Stream mapping:
  Stream #0:0 -> #0:0 (vp8 (native) -> h264 (libx264))
  Stream #0:1 -> #0:1 (vorbis (native) -> aac (native))
Press [q] to stop, [?] for help
[libx264 @ 0x2146040] using SAR=1/1
[libx264 @ 0x2146040] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2
[libx264 @ 0x2146040] profile High, level 4.2
[libx264 @ 0x2146040] 264 - core 148 r2643 5c65704 - H.264/MPEG-4 AVC codec - Copyleft 2003-2015 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to 'rudebear.webm.mp4':
  Metadata:
    encoder         : Lavf57.71.100
    Stream #0:0(eng): Video: h264 (libx264) ([33][0][0][0] / 0x0021), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], q=-1--1, 60 fps, 15360 tbn, 60 tbc (default)
    Metadata:
      encoder         : Lavc57.89.100 libx264
    Side data:
      cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: -1
    Stream #0:1(eng): Audio: aac (LC) ([64][0][0][0] / 0x0040), 48000 Hz, stereo, fltp, 128 kb/s (default)
    Metadata:
      encoder         : Lavc57.89.100 aac
frame= 3211 fps= 18 q=-1.0 Lsize=   50187kB time=00:00:53.57 bitrate=7674.5kbits/s dup=1 drop=0 speed=0.292x    
video:49254kB audio:855kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.154524%
bench: utime=1329.150s
bench: maxrss=679728kB
[libx264 @ 0x2146040] frame I:33    Avg QP:20.91  size:106260
[libx264 @ 0x2146040] frame P:1906  Avg QP:26.40  size: 21760
[libx264 @ 0x2146040] frame B:1272  Avg QP:27.71  size:  4287
[libx264 @ 0x2146040] consecutive B-frames: 38.6% 21.4% 12.7% 27.3%
[libx264 @ 0x2146040] mb I  I16..4: 23.5% 43.1% 33.5%
[libx264 @ 0x2146040] mb P  I16..4:  4.3%  5.2%  1.4%  P16..4: 35.3%  6.0%  2.6%  0.0%  0.0%    skip:45.3%
[libx264 @ 0x2146040] mb B  I16..4:  0.3%  0.3%  0.1%  B16..8: 23.4%  1.3%  0.2%  direct: 0.5%  skip:73.9%  L0:51.8% L1:45.5% BI: 2.6%
[libx264 @ 0x2146040] 8x8 transform intra:47.2% inter:70.0%
[libx264 @ 0x2146040] coded y,uvDC,uvAC intra: 33.4% 46.1% 13.8% inter: 10.6% 8.0% 0.4%
[libx264 @ 0x2146040] i16 v,h,dc,p: 30% 33% 21% 15%
[libx264 @ 0x2146040] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 28% 21% 30%  3%  3%  4%  4%  3%  4%
[libx264 @ 0x2146040] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 29% 26% 16%  4%  5%  6%  5%  4%  4%
[libx264 @ 0x2146040] i8c dc,h,v,p: 57% 22% 16%  5%
[libx264 @ 0x2146040] Weighted P-Frames: Y:10.3% UV:3.8%
[libx264 @ 0x2146040] ref P L0: 62.1% 24.1% 10.1%  3.3%  0.3%
[libx264 @ 0x2146040] ref B L0: 90.0%  8.9%  1.0%
[libx264 @ 0x2146040] ref B L1: 96.6%  3.4%
[libx264 @ 0x2146040] kb/s:7539.38
[aac @ 0x2154680] Qavg: 2073.511

real    3m3.585s
user    22m9.170s
sys 0m4.390s
mikekasprzak commented 7 years ago

SOUPE: Scaleway ARMv8 64bit, VPS 2 Core, 2 GB RAM, Ubuntu 16.04

soupe:~# time ./to_mp4.sh rudebear.webm
ffmpeg version 2.8.11-0ubuntu0.16.04.1 Copyright (c) 2000-2017 the FFmpeg developers
  built with gcc 5.4.0 (Ubuntu/Linaro 5.4.0-6ubuntu1~16.04.4) 20160609
  configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/aarch64-linux-gnu --incdir=/usr/include/aarch64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
  libavutil      54. 31.100 / 54. 31.100
  libavcodec     56. 60.100 / 56. 60.100
  libavformat    56. 40.101 / 56. 40.101
  libavdevice    56.  4.100 / 56.  4.100
  libavfilter     5. 40.101 /  5. 40.101
  libavresample   2.  1.  0 /  2.  1.  0
  libswscale      3.  1.101 /  3.  1.101
  libswresample   1.  2.101 /  1.  2.101
  libpostproc    53.  3.100 / 53.  3.100
Input #0, matroska,webm, from 'rudebear.webm':
  Metadata:
    encoder         : Lavf56.25.101
  Duration: 00:00:53.55, start: 0.000000, bitrate: 5718 kb/s
    Stream #0:0(eng): Video: vp8, yuv420p, 1920x1080, SAR 1:1 DAR 16:9, 60 fps, 60 tbr, 1k tbn, 1k tbc (default)
    Stream #0:1(eng): Audio: vorbis, 48000 Hz, stereo, fltp (default)
[libx264 @ 0x3347260] using SAR=1/1
[libx264 @ 0x3347260] using cpu capabilities: ARMv8 NEON
[libx264 @ 0x3347260] profile High, level 4.2
[libx264 @ 0x3347260] 264 - core 148 r2643 5c65704 - H.264/MPEG-4 AVC codec - Copyleft 2003-2015 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=3 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to 'rudebear.webm.mp4':
  Metadata:
    encoder         : Lavf56.40.101
    Stream #0:0(eng): Video: h264 (libx264) ([33][0][0][0] / 0x0021), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], q=-1--1, 60 fps, 15360 tbn, 60 tbc (default)
    Metadata:
      encoder         : Lavc56.60.100 libx264
    Stream #0:1(eng): Audio: aac ([64][0][0][0] / 0x0040), 48000 Hz, stereo, fltp, 128 kb/s (default)
    Metadata:
      encoder         : Lavc56.60.100 aac
Stream mapping:
  Stream #0:0 -> #0:0 (vp8 (native) -> h264 (libx264))
  Stream #0:1 -> #0:1 (vorbis (native) -> aac (native))
Press [q] to stop, [?] for help
frame= 3211 fps=2.1 q=-1.0 Lsize=   50209kB time=00:00:53.57 bitrate=7678.0kbits/s dup=1 drop=0    
video:49241kB audio:890kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.156342%
bench: utime=2985.380s
bench: maxrss=497752kB
[libx264 @ 0x3347260] frame I:33    Avg QP:20.82  size:106889
[libx264 @ 0x3347260] frame P:1824  Avg QP:26.31  size: 22334
[libx264 @ 0x3347260] frame B:1354  Avg QP:27.82  size:  4548
[libx264 @ 0x3347260] consecutive B-frames: 34.9% 22.1% 13.7% 29.3%
[libx264 @ 0x3347260] mb I  I16..4: 24.0% 42.6% 33.4%
[libx264 @ 0x3347260] mb P  I16..4:  4.5%  5.3%  1.4%  P16..4: 35.6%  6.2%  2.7%  0.0%  0.0%    skip:44.4%
[libx264 @ 0x3347260] mb B  I16..4:  0.4%  0.3%  0.1%  B16..8: 24.2%  1.4%  0.2%  direct: 0.5%  skip:72.9%  L0:52.0% L1:45.2% BI: 2.8%
[libx264 @ 0x3347260] 8x8 transform intra:46.5% inter:70.1%
[libx264 @ 0x3347260] coded y,uvDC,uvAC intra: 33.2% 46.1% 13.8% inter: 10.6% 7.9% 0.4%
[libx264 @ 0x3347260] i16 v,h,dc,p: 31% 33% 21% 15%
[libx264 @ 0x3347260] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 26% 21% 33%  3%  3%  4%  4%  3%  4%
[libx264 @ 0x3347260] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 28% 26% 16%  4%  6%  6%  5%  4%  4%
[libx264 @ 0x3347260] i8c dc,h,v,p: 57% 22% 16%  5%
[libx264 @ 0x3347260] Weighted P-Frames: Y:10.7% UV:4.2%
[libx264 @ 0x3347260] ref P L0: 62.0% 23.9% 10.3%  3.4%  0.3%
[libx264 @ 0x3347260] ref B L0: 90.3%  8.7%  1.0%
[libx264 @ 0x3347260] ref B L1: 96.5%  3.5%
[libx264 @ 0x3347260] kb/s:7537.48

real    25m27.405s
user    49m45.612s
sys 0m5.124s
mikekasprzak commented 7 years ago

COOR: Scaleway ARMv7 32bit, VPS 2 Core, 2 GB RAM, Ubuntu 16.04

coor:~# time ./to_mp4.sh rudebear.webm
ffmpeg version 2.8.11-0ubuntu0.16.04.1 Copyright (c) 2000-2017 the FFmpeg developers
  built with gcc 5.4.0 (Ubuntu/Linaro 5.4.0-6ubuntu1~16.04.4) 20160609
  configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/arm-linux-gnueabihf --incdir=/usr/include/arm-linux-gnueabihf --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
  libavutil      54. 31.100 / 54. 31.100
  libavcodec     56. 60.100 / 56. 60.100
  libavformat    56. 40.101 / 56. 40.101
  libavdevice    56.  4.100 / 56.  4.100
  libavfilter     5. 40.101 /  5. 40.101
  libavresample   2.  1.  0 /  2.  1.  0
  libswscale      3.  1.101 /  3.  1.101
  libswresample   1.  2.101 /  1.  2.101
  libpostproc    53.  3.100 / 53.  3.100
Input #0, matroska,webm, from 'rudebear.webm':
  Metadata:
    encoder         : Lavf56.25.101
  Duration: 00:00:53.55, start: 0.000000, bitrate: 5718 kb/s
    Stream #0:0(eng): Video: vp8, yuv420p, 1920x1080, SAR 1:1 DAR 16:9, 60 fps, 60 tbr, 1k tbn, 1k tbc (default)
    Stream #0:1(eng): Audio: vorbis, 48000 Hz, stereo, fltp (default)
[libx264 @ 0xa68a0] using SAR=1/1
[libx264 @ 0xa68a0] using cpu capabilities: ARMv6
[libx264 @ 0xa68a0] profile High, level 4.2
[libx264 @ 0xa68a0] 264 - core 148 r2643 5c65704 - H.264/MPEG-4 AVC codec - Copyleft 2003-2015 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=6 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to 'rudebear.webm.mp4':
  Metadata:
    encoder         : Lavf56.40.101
    Stream #0:0(eng): Video: h264 (libx264) ([33][0][0][0] / 0x0021), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], q=-1--1, 60 fps, 15360 tbn, 60 tbc (default)
    Metadata:
      encoder         : Lavc56.60.100 libx264
    Stream #0:1(eng): Audio: aac ([64][0][0][0] / 0x0040), 48000 Hz, stereo, fltp, 128 kb/s (default)
    Metadata:
      encoder         : Lavc56.60.100 aac
Stream mapping:
  Stream #0:0 -> #0:0 (vp8 (native) -> h264 (libx264))
  Stream #0:1 -> #0:1 (vorbis (native) -> aac (native))
Press [q] to stop, [?] for help
frame= 3211 fps=0.8 q=-1.0 Lsize=   50217kB time=00:00:53.57 bitrate=7679.2kbits/s dup=1 drop=0    
video:49249kB audio:890kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.156317%
bench: utime=15821.160s
bench: maxrss=529740kB
[libx264 @ 0xa68a0] frame I:33    Avg QP:20.82  size:106890
[libx264 @ 0xa68a0] frame P:1824  Avg QP:26.32  size: 22339
[libx264 @ 0xa68a0] frame B:1354  Avg QP:27.77  size:  4547
[libx264 @ 0xa68a0] consecutive B-frames: 34.9% 22.1% 13.7% 29.3%
[libx264 @ 0xa68a0] mb I  I16..4: 24.0% 42.6% 33.5%
[libx264 @ 0xa68a0] mb P  I16..4:  4.5%  5.3%  1.4%  P16..4: 35.6%  6.2%  2.7%  0.0%  0.0%    skip:44.4%
[libx264 @ 0xa68a0] mb B  I16..4:  0.4%  0.3%  0.1%  B16..8: 24.2%  1.4%  0.2%  direct: 0.5%  skip:72.9%  L0:51.9% L1:45.3% BI: 2.7%
[libx264 @ 0xa68a0] 8x8 transform intra:46.4% inter:70.1%
[libx264 @ 0xa68a0] coded y,uvDC,uvAC intra: 33.2% 46.0% 13.8% inter: 10.6% 7.9% 0.4%
[libx264 @ 0xa68a0] i16 v,h,dc,p: 31% 33% 21% 15%
[libx264 @ 0xa68a0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 26% 21% 33%  3%  3%  4%  4%  3%  4%
[libx264 @ 0xa68a0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 28% 26% 16%  4%  6%  6%  5%  4%  4%
[libx264 @ 0xa68a0] i8c dc,h,v,p: 57% 22% 16%  5%
[libx264 @ 0xa68a0] Weighted P-Frames: Y:10.7% UV:4.2%
[libx264 @ 0xa68a0] ref P L0: 62.0% 23.9% 10.3%  3.4%  0.3%
[libx264 @ 0xa68a0] ref B L0: 90.4%  8.6%  1.0%
[libx264 @ 0xa68a0] ref B L1: 96.5%  3.5%
[libx264 @ 0xa68a0] kb/s:7538.59

real    68m40.504s
user    263m41.520s
sys 0m7.180s
mikekasprzak commented 7 years ago

Conclusion

ARMv8 isn't bad, but as far as 1:1 pricing goes, Intel is a better value as you get nearly 2:1 performance. Still, it's a huge step forward over ARMv7 (6:1 Intel, 3:1 ARMv8).

mikekasprzak commented 6 years ago

Linode *just* launched block storage, and I've already managed to get it setup and working. Just needs to be swapped for the real thing, and the toolchain needs fixes.

Upside: Easy. A couple hours and we're done. Transcoding server can be separate now.

Downside: Cost. With more effort we could have acquired blocks of 150 GB for roughly $3.75/mo each (plus $7.50/mo base price). Right now we're paying $1 per 10 GB, and every LD event we run we're going to have to bump that up by $1. That $7.50/mo also gave us a 4 core machine that could have had 3 cores allocated to trans-coding.

mikekasprzak commented 6 years ago

No longer an issue. Transcoding is now a separate issue #1631.