mapconcierge commented 1 year ago

mapilary_tools を用いて複数mp4ファイルをまとめて変換処理しMapillaryにアップロードする作業ログ

STEP0a: mapillary_tools 最新版インストール方法とログイン方法

Python3がインストールされていなければインストール

https://www.python.org/downloads/

pipを用いたインストール

% python3 -m pip install --upgrade mapillary_tools

自分のMapillaryアカウントで認証（古橋のアカウント名は mapconcierge）

% mapillary_tools authenticate --user_name "mapconcierge"

taichi@TaichinoMacBook-Pro-15137 ~ % python3 -m pip install --upgrade mapillary_tools

Requirement already satisfied: mapillary_tools in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (0.9.0)
Collecting mapillary_tools
  Downloading mapillary_tools-0.9.5-py3-none-any.whl (95 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95.2/95.2 kB 2.8 MB/s eta 0:00:00
Requirement already satisfied: pynmea2==1.12.0 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from mapillary_tools) (1.12.0)
Requirement already satisfied: piexif==1.1.3 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from mapillary_tools) (1.1.3)
Requirement already satisfied: jsonschema in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from mapillary_tools) (4.13.0)
Requirement already satisfied: tqdm<5.0,>=4.0 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from mapillary_tools) (4.64.0)
Requirement already satisfied: gpxpy==1.4.2 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from mapillary_tools) (1.4.2)
Requirement already satisfied: requests<3.0.0,>=2.20.0 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from mapillary_tools) (2.28.1)
Requirement already satisfied: appdirs<2.0.0,>=1.4.4 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from mapillary_tools) (1.4.4)
Requirement already satisfied: exifread==2.3.2 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from mapillary_tools) (2.3.2)
Requirement already satisfied: construct<3.0.0,>=2.10.0 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from mapillary_tools) (2.10.68)
Requirement already satisfied: typing-extensions in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from mapillary_tools) (4.3.0)
Requirement already satisfied: idna<4,>=2.5 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from requests<3.0.0,>=2.20.0->mapillary_tools) (3.3)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from requests<3.0.0,>=2.20.0->mapillary_tools) (1.26.11)
Requirement already satisfied: certifi>=2017.4.17 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from requests<3.0.0,>=2.20.0->mapillary_tools) (2022.6.15)
Requirement already satisfied: charset-normalizer<3,>=2 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from requests<3.0.0,>=2.20.0->mapillary_tools) (2.1.1)
Requirement already satisfied: attrs>=17.4.0 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from jsonschema->mapillary_tools) (22.1.0)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from jsonschema->mapillary_tools) (0.18.1)
Installing collected packages: mapillary_tools
  Attempting uninstall: mapillary_tools
    Found existing installation: mapillary-tools 0.9.0
    Uninstalling mapillary-tools-0.9.0:
      Successfully uninstalled mapillary-tools-0.9.0
Successfully installed mapillary_tools-0.9.5

[notice] A new release of pip available: 22.2.2 -> 22.3.1
[notice] To update, run: pip install --upgrade pip
taichi@TaichinoMacBook-Pro-15137 ~ %

STEP0b: mapillary_tools 最新版アップデート方法

% python3 -m pip install --force-reinstall --upgrade git+https://github.com/mapillary/mapillary_tools

mapconcierge commented 1 year ago

STEP1: 最初に、複数のmp4ファイルを一括してフレーム分解

デフォルトは 5m/2sec ごとに処理

% mapillary_tools video_process "." --geotag_source "camm"

2FPS動画を処理する場合は --video_sample_interval=0.5 引数を追加

% mapillary_tools video_process "." --geotag_source "camm" --video_sample_interval=0.5

taichi@TaichinoMacBook-Pro-15137 all % pwd
/Users/taichi/Movies/firenze20220827central0700mapconcierge01thx01/all
taichi@TaichinoMacBook-Pro-15137 all % ls -al
total 6324616
drwxr-xr-x  9 taichi  staff        288 12 31 07:01 .
drwxr-xr-x  9 taichi  staff        288 12 31 07:01 ..
-rwxrwxrwx  1 taichi  staff  626341605  8 27 14:07 R0020627.MP4
-rwxrwxrwx@ 1 taichi  staff   13780925  8 27 14:09 R0020628.MP4
-rwxrwxrwx@ 1 taichi  staff  623482507  8 27 14:14 R0020629.MP4
-rwxrwxrwx  1 taichi  staff  307187616  8 27 14:17 R0020630.MP4
-rwxrwxrwx  1 taichi  staff  619252907  8 27 14:32 R0020631.MP4
-rwxrwxrwx  1 taichi  staff  623364001  8 27 14:37 R0020632.MP4
-rwxrwxrwx@ 1 taichi  staff  424780870  8 27 14:41 R0020633.MP4
taichi@TaichinoMacBook-Pro-15137 all % mapillary_tools video_process "." --geotag_source "camm"
2022-12-31 07:02:53,069 - INFO    - Extracting video information: ffprobe -print_format json -hide_banner -show_format -show_streams R0020632.MP4
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x132605690] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x132605690] DTS discontinuity in stream 2: packet 346 with DTS 857648240, packet 347 with DTS 862633594
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0020632.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2022-08-27T05:37:42.000000Z
    com.apple.quicktime.location.ISO6709: +43.7772+011.2521+0044/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:05:01.79, start: 0.000000, bitrate: 16524 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 256 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:37:42.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16066 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:37:42.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 572938 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:37:42.000000Z
      handler_name    : CameraMetadataMotionHandler
Unsupported codec with id 0 for input stream 2
2022-12-31 07:02:53,372 - INFO    - Extracting frames: ffmpeg -i R0020632.MP4 -vf fps=1/2.0 -hide_banner -qscale:v 1 -nostdin /Users/taichi/Movies/firenze20220827central0700mapconcierge01thx01/all/mapillary_sampled_video_frames/.mly_ffmpeg_R0020632.MP4.35322.1672437773/R0020632_%06d.jpg
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x147e05690] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x147e05690] DTS discontinuity in stream 2: packet 346 with DTS 857648240, packet 347 with DTS 862633594
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0020632.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2022-08-27T05:37:42.000000Z
    com.apple.quicktime.location.ISO6709: +43.7772+011.2521+0044/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:05:01.79, start: 0.000000, bitrate: 16524 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 256 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:37:42.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16066 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:37:42.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 572938 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:37:42.000000Z
      handler_name    : CameraMetadataMotionHandler
Stream mapping:
  Stream #0:1 -> #0:0 (h264 (native) -> mjpeg (native))
Output #0, image2, to '/Users/taichi/Movies/firenze20220827central0700mapconcierge01thx01/all/mapillary_sampled_video_frames/.mly_ffmpeg_R0020632.MP4.35322.1672437773/R0020632_%06d.jpg':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    model           : RICOH THETA X
    com.apple.quicktime.location.ISO6709: +43.7772+011.2521+0044/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    encoder         : Lavf59.27.100
  Stream #0:0(eng): Video: mjpeg, yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840 [SAR 1:1 DAR 2:1], q=2-31, 200 kb/s, 0.50 fps, 0.50 tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:37:42.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
      encoder         : Lavc59.37.100 mjpeg
    Side data:
      cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: N/A
      spherical: equirectangular (0.000000/0.000000/0.000000) 
frame=  151 fps= 15 q=1.0 Lsize=N/A time=00:05:02.00 bitrate=N/A speed=30.8x    
video:252666kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
2022-12-31 07:03:03,862 - INFO    - Extracting video information: ffprobe -print_format json -hide_banner -show_format -show_streams R0020633.MP4
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x1357040a0] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x1357040a0] DTS discontinuity in stream 2: packet 366 with DTS 907502041, packet 367 with DTS 912487343
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0020633.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2022-08-27T05:41:35.000000Z
    com.apple.quicktime.location.ISO6709: +43.7735+011.2546+0046/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:03:24.10, start: 0.000000, bitrate: 16650 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 255 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:41:35.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16183 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:41:35.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 572898 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:41:35.000000Z
      handler_name    : CameraMetadataMotionHandler
Unsupported codec with id 0 for input stream 2
2022-12-31 07:03:04,022 - INFO    - Extracting frames: ffmpeg -i R0020633.MP4 -vf fps=1/2.0 -hide_banner -qscale:v 1 -nostdin /Users/taichi/Movies/firenze20220827central0700mapconcierge01thx01/all/mapillary_sampled_video_frames/.mly_ffmpeg_R0020633.MP4.35322.1672437784/R0020633_%06d.jpg
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x14fe05690] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x14fe05690] DTS discontinuity in stream 2: packet 366 with DTS 907502041, packet 367 with DTS 912487343
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0020633.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2022-08-27T05:41:35.000000Z
    com.apple.quicktime.location.ISO6709: +43.7735+011.2546+0046/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:03:24.10, start: 0.000000, bitrate: 16650 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 255 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:41:35.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16183 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:41:35.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 572898 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:41:35.000000Z
      handler_name    : CameraMetadataMotionHandler
Stream mapping:
  Stream #0:1 -> #0:0 (h264 (native) -> mjpeg (native))
Output #0, image2, to '/Users/taichi/Movies/firenze20220827central0700mapconcierge01thx01/all/mapillary_sampled_video_frames/.mly_ffmpeg_R0020633.MP4.35322.1672437784/R0020633_%06d.jpg':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    model           : RICOH THETA X
    com.apple.quicktime.location.ISO6709: +43.7735+011.2546+0046/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    encoder         : Lavf59.27.100
  Stream #0:0(eng): Video: mjpeg, yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840 [SAR 1:1 DAR 2:1], q=2-31, 200 kb/s, 0.50 fps, 0.50 tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:41:35.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
      encoder         : Lavc59.37.100 mjpeg
    Side data:
      cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: N/A
      spherical: equirectangular (0.000000/0.000000/0.000000) 
frame=  102 fps= 17 q=1.0 Lsize=N/A time=00:03:24.00 bitrate=N/A speed=33.3x    
video:178963kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
2022-12-31 07:03:10,653 - INFO    - Extracting video information: ffprobe -print_format json -hide_banner -show_format -show_streams R0020627.MP4
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x129704a90] UDTA parsing failed retrying raw
    Last message repeated 1 times
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0020627.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2022-08-27T05:07:37.000000Z
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:05:02.18, start: 0.000000, bitrate: 16581 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 256 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:07:37.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16117 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:07:37.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 572289 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:07:37.000000Z
      handler_name    : CameraMetadataMotionHandler
Unsupported codec with id 0 for input stream 2
2022-12-31 07:03:10,801 - INFO    - Extracting frames: ffmpeg -i R0020627.MP4 -vf fps=1/2.0 -hide_banner -qscale:v 1 -nostdin /Users/taichi/Movies/firenze20220827central0700mapconcierge01thx01/all/mapillary_sampled_video_frames/.mly_ffmpeg_R0020627.MP4.35322.1672437790/R0020627_%06d.jpg
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x123f04680] UDTA parsing failed retrying raw
    Last message repeated 1 times
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0020627.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2022-08-27T05:07:37.000000Z
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:05:02.18, start: 0.000000, bitrate: 16581 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 256 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:07:37.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16117 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:07:37.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 572289 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:07:37.000000Z
      handler_name    : CameraMetadataMotionHandler
Stream mapping:
  Stream #0:1 -> #0:0 (h264 (native) -> mjpeg (native))
Output #0, image2, to '/Users/taichi/Movies/firenze20220827central0700mapconcierge01thx01/all/mapillary_sampled_video_frames/.mly_ffmpeg_R0020627.MP4.35322.1672437790/R0020627_%06d.jpg':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    model           : RICOH THETA X
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    encoder         : Lavf59.27.100
  Stream #0:0(eng): Video: mjpeg, yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840 [SAR 1:1 DAR 2:1], q=2-31, 200 kb/s, 0.50 fps, 0.50 tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:07:37.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
      encoder         : Lavc59.37.100 mjpeg
    Side data:
      cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: N/A
      spherical: equirectangular (0.000000/0.000000/0.000000) 
frame=  151 fps= 18 q=1.0 Lsize=N/A time=00:05:02.00 bitrate=N/A speed=35.3x    
video:235103kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
2022-12-31 07:03:20,022 - INFO    - Extracting video information: ffprobe -print_format json -hide_banner -show_format -show_streams R0020631.MP4
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x13a605690] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x13a605690] DTS discontinuity in stream 2: packet 348 with DTS 862562823, packet 349 with DTS 867547760
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0020631.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2022-08-27T05:32:34.000000Z
    com.apple.quicktime.location.ISO6709: +43.7859+011.2502+0048/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:04:59.68, start: 0.000000, bitrate: 16530 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 255 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:32:34.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16067 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:32:34.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 572949 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:32:34.000000Z
      handler_name    : CameraMetadataMotionHandler
Unsupported codec with id 0 for input stream 2
2022-12-31 07:03:20,165 - INFO    - Extracting frames: ffmpeg -i R0020631.MP4 -vf fps=1/2.0 -hide_banner -qscale:v 1 -nostdin /Users/taichi/Movies/firenze20220827central0700mapconcierge01thx01/all/mapillary_sampled_video_frames/.mly_ffmpeg_R0020631.MP4.35322.1672437800/R0020631_%06d.jpg
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x14a605690] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x14a605690] DTS discontinuity in stream 2: packet 348 with DTS 862562823, packet 349 with DTS 867547760
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0020631.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2022-08-27T05:32:34.000000Z
    com.apple.quicktime.location.ISO6709: +43.7859+011.2502+0048/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:04:59.68, start: 0.000000, bitrate: 16530 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 255 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:32:34.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16067 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:32:34.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 572949 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:32:34.000000Z
      handler_name    : CameraMetadataMotionHandler
Stream mapping:
  Stream #0:1 -> #0:0 (h264 (native) -> mjpeg (native))
Output #0, image2, to '/Users/taichi/Movies/firenze20220827central0700mapconcierge01thx01/all/mapillary_sampled_video_frames/.mly_ffmpeg_R0020631.MP4.35322.1672437800/R0020631_%06d.jpg':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    model           : RICOH THETA X
    com.apple.quicktime.location.ISO6709: +43.7859+011.2502+0048/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    encoder         : Lavf59.27.100
  Stream #0:0(eng): Video: mjpeg, yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840 [SAR 1:1 DAR 2:1], q=2-31, 200 kb/s, 0.50 fps, 0.50 tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:32:34.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
      encoder         : Lavc59.37.100 mjpeg
    Side data:
      cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: N/A
      spherical: equirectangular (0.000000/0.000000/0.000000) 
frame=  150 fps= 17 q=1.0 Lsize=N/A time=00:05:00.00 bitrate=N/A speed=34.8x    
video:269149kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
2022-12-31 07:03:29,518 - INFO    - Extracting video information: ffprobe -print_format json -hide_banner -show_format -show_streams R0020630.MP4
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x11f704a90] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x11f704a90] DTS discontinuity in stream 2: packet 356 with DTS 882581156, packet 357 with DTS 887566458
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0020630.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2022-08-27T05:17:10.000000Z
    com.apple.quicktime.location.ISO6709: +43.7820+011.2530+0056/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:02:27.79, start: 0.000000, bitrate: 16628 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 255 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:17:10.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16186 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:17:10.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 572818 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:17:10.000000Z
      handler_name    : CameraMetadataMotionHandler
Unsupported codec with id 0 for input stream 2
2022-12-31 07:03:29,659 - INFO    - Extracting frames: ffmpeg -i R0020630.MP4 -vf fps=1/2.0 -hide_banner -qscale:v 1 -nostdin /Users/taichi/Movies/firenze20220827central0700mapconcierge01thx01/all/mapillary_sampled_video_frames/.mly_ffmpeg_R0020630.MP4.35322.1672437809/R0020630_%06d.jpg
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x151605690] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x151605690] DTS discontinuity in stream 2: packet 356 with DTS 882581156, packet 357 with DTS 887566458
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0020630.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2022-08-27T05:17:10.000000Z
    com.apple.quicktime.location.ISO6709: +43.7820+011.2530+0056/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:02:27.79, start: 0.000000, bitrate: 16628 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 255 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:17:10.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16186 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:17:10.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 572818 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:17:10.000000Z
      handler_name    : CameraMetadataMotionHandler
Stream mapping:
  Stream #0:1 -> #0:0 (h264 (native) -> mjpeg (native))
Output #0, image2, to '/Users/taichi/Movies/firenze20220827central0700mapconcierge01thx01/all/mapillary_sampled_video_frames/.mly_ffmpeg_R0020630.MP4.35322.1672437809/R0020630_%06d.jpg':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    model           : RICOH THETA X
    com.apple.quicktime.location.ISO6709: +43.7820+011.2530+0056/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    encoder         : Lavf59.27.100
  Stream #0:0(eng): Video: mjpeg, yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840 [SAR 1:1 DAR 2:1], q=2-31, 200 kb/s, 0.50 fps, 0.50 tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:17:10.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
      encoder         : Lavc59.37.100 mjpeg
    Side data:
      cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: N/A
      spherical: equirectangular (0.000000/0.000000/0.000000) 
frame=   74 fps= 17 q=1.0 Lsize=N/A time=00:02:28.00 bitrate=N/A speed=33.8x    
video:120431kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
2022-12-31 07:03:34,401 - INFO    - Extracting video information: ffprobe -print_format json -hide_banner -show_format -show_streams R0020629.MP4
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x15b605690] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x15b605690] DTS discontinuity in stream 2: packet 348 with DTS 862572979, packet 349 with DTS 867557916
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0020629.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2022-08-27T05:14:31.000000Z
    com.apple.quicktime.location.ISO6709: +43.7749+011.2549+0058/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:05:02.14, start: 0.000000, bitrate: 16508 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 256 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:14:31.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16043 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:14:31.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 569042 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:14:31.000000Z
      handler_name    : CameraMetadataMotionHandler
Unsupported codec with id 0 for input stream 2
2022-12-31 07:03:34,532 - INFO    - Extracting frames: ffmpeg -i R0020629.MP4 -vf fps=1/2.0 -hide_banner -qscale:v 1 -nostdin /Users/taichi/Movies/firenze20220827central0700mapconcierge01thx01/all/mapillary_sampled_video_frames/.mly_ffmpeg_R0020629.MP4.35322.1672437814/R0020629_%06d.jpg
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x1517040b0] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x1517040b0] DTS discontinuity in stream 2: packet 348 with DTS 862572979, packet 349 with DTS 867557916
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0020629.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2022-08-27T05:14:31.000000Z
    com.apple.quicktime.location.ISO6709: +43.7749+011.2549+0058/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:05:02.14, start: 0.000000, bitrate: 16508 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 256 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:14:31.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16043 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:14:31.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 569042 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:14:31.000000Z
      handler_name    : CameraMetadataMotionHandler
Stream mapping:
  Stream #0:1 -> #0:0 (h264 (native) -> mjpeg (native))
Output #0, image2, to '/Users/taichi/Movies/firenze20220827central0700mapconcierge01thx01/all/mapillary_sampled_video_frames/.mly_ffmpeg_R0020629.MP4.35322.1672437814/R0020629_%06d.jpg':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    model           : RICOH THETA X
    com.apple.quicktime.location.ISO6709: +43.7749+011.2549+0058/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    encoder         : Lavf59.27.100
  Stream #0:0(eng): Video: mjpeg, yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840 [SAR 1:1 DAR 2:1], q=2-31, 200 kb/s, 0.50 fps, 0.50 tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:14:31.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
      encoder         : Lavc59.37.100 mjpeg
    Side data:
      cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: N/A
      spherical: equirectangular (0.000000/0.000000/0.000000) 
frame=  151 fps= 17 q=1.0 Lsize=N/A time=00:05:02.00 bitrate=N/A speed=34.5x    
video:243836kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
2022-12-31 07:03:43,851 - INFO    - Extracting video information: ffprobe -print_format json -hide_banner -show_format -show_streams R0020628.MP4
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x13f7040a0] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x13f7040a0] DTS discontinuity in stream 2: packet 352 with DTS 872540063, packet 353 with DTS 877525000
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0020628.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2022-08-27T05:09:01.000000Z
    com.apple.quicktime.location.ISO6709: +43.7748+011.2549+0062/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:00:03.51, start: 0.000000, bitrate: 31454 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 259 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:09:01.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 30932 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:09:01.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 572227 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:09:01.000000Z
      handler_name    : CameraMetadataMotionHandler
Unsupported codec with id 0 for input stream 2
2022-12-31 07:03:43,977 - INFO    - Extracting frames: ffmpeg -i R0020628.MP4 -vf fps=1/2.0 -hide_banner -qscale:v 1 -nostdin /Users/taichi/Movies/firenze20220827central0700mapconcierge01thx01/all/mapillary_sampled_video_frames/.mly_ffmpeg_R0020628.MP4.35322.1672437823/R0020628_%06d.jpg
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x157f040b0] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x157f040b0] DTS discontinuity in stream 2: packet 352 with DTS 872540063, packet 353 with DTS 877525000
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0020628.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2022-08-27T05:09:01.000000Z
    com.apple.quicktime.location.ISO6709: +43.7748+011.2549+0062/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:00:03.51, start: 0.000000, bitrate: 31454 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 259 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:09:01.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 30932 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:09:01.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 572227 kb/s (default)
    Metadata:
      creation_time   : 2022-08-27T05:09:01.000000Z
      handler_name    : CameraMetadataMotionHandler
Stream mapping:
  Stream #0:1 -> #0:0 (h264 (native) -> mjpeg (native))
Output #0, image2, to '/Users/taichi/Movies/firenze20220827central0700mapconcierge01thx01/all/mapillary_sampled_video_frames/.mly_ffmpeg_R0020628.MP4.35322.1672437823/R0020628_%06d.jpg':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    model           : RICOH THETA X
    com.apple.quicktime.location.ISO6709: +43.7748+011.2549+0062/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    encoder         : Lavf59.27.100
  Stream #0:0(eng): Video: mjpeg, yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840 [SAR 1:1 DAR 2:1], q=2-31, 200 kb/s, 0.50 fps, 0.50 tbn (default)
    Metadata:
      creation_time   : 2022-08-27T05:09:01.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
      encoder         : Lavc59.37.100 mjpeg
    Side data:
      cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: N/A
      spherical: equirectangular (0.000000/0.000000/0.000000) 
frame=    2 fps=0.0 q=1.0 Lsize=N/A time=00:00:04.00 bitrate=N/A speed=14.1x    
video:3256kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
Interpolating R0020632.MP4: 100%|█████████████████████████████████████████████████████████████████████████████████████████████| 151/151 [00:00<00:00, 5006.80images/s]
Interpolating R0020633.MP4: 100%|█████████████████████████████████████████████████████████████████████████████████████████████| 102/102 [00:00<00:00, 5483.87images/s]
Interpolating R0020627.MP4: 100%|█████████████████████████████████████████████████████████████████████████████████████████████| 151/151 [00:00<00:00, 5511.57images/s]
Interpolating R0020631.MP4: 100%|█████████████████████████████████████████████████████████████████████████████████████████████| 150/150 [00:00<00:00, 5129.94images/s]
Interpolating R0020630.MP4: 100%|███████████████████████████████████████████████████████████████████████████████████████████████| 74/74 [00:00<00:00, 5182.74images/s]
Interpolating R0020629.MP4: 100%|████████████████████████████████████████████████████████████████████████████████████████████| 151/151 [00:00<00:00, 16852.66images/s]
2022-12-31 07:03:57,819 - WARNING - Fail 2 sample images due to stationary video R0020628.MP4
Test EXIF writing: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████| 741/741 [00:01<00:00, 703.58images/s]
2022-12-31 07:04:03,090 - INFO    - Check the image description file for details: mapillary_sampled_video_frames/mapillary_image_description.json
2022-12-31 07:04:03,090 - INFO    -      781 images read in total
2022-12-31 07:04:03,090 - INFO    -      741 images processed and ready to be uploaded
2022-12-31 07:04:03,091 - WARNING -       38 images failed due to MapillaryOutsideGPXTrackError
2022-12-31 07:04:03,091 - WARNING -        2 images failed due to MapillaryStationaryVideoError
2022-12-31 07:04:03,091 - ERROR   - MapillaryProcessError: Failed to process 40 images. To skip these errors, specify --skip_process_errors

mapconcierge commented 1 year ago

STEP2: フレーム分解した大量のjpgファイルと、CAMMメタデータから生成した mapillary_image_description.json ファイルをセットで Mapillaryにアップロード

% mapillary_tools upload "./mapillary_sampled_video_frames/" --desc_path "./mapillary_sampled_video_frames/mapillary_image_description.json"

taichi@TaichinoMacBook-Pro-15137 all % mapillary_tools upload  "./mapillary_sampled_video_frames/" --desc_path "./mapillary_sampled_video_frames/mapillary_image_description.json"
Uploading IMAGE (1/6): 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████| 245M/245M [00:49<00:00, 5.23MB/s]
Uploading IMAGE (2/6): 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████| 170M/170M [00:34<00:00, 5.13MB/s]
Uploading IMAGE (3/6): 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████| 185M/185M [00:33<00:00, 5.75MB/s]
Uploading IMAGE (4/6): 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████| 261M/261M [00:50<00:00, 5.45MB/s]
Uploading IMAGE (5/6): 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████| 116M/116M [00:19<00:00, 6.12MB/s]
Uploading IMAGE (6/6): 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████| 237M/237M [00:44<00:00, 5.61MB/s]
2022-12-31 07:09:25,243 - INFO    -        6  IMAGE sequences uploaded
2022-12-31 07:09:25,243 - INFO    -   1213.7M data in total
2022-12-31 07:09:25,244 - INFO    -   1213.7M data uploaded
2022-12-31 07:09:25,244 - INFO    -    232.0s upload time
taichi@TaichinoMacBook-Pro-15137 all %

mapconcierge commented 1 year ago

アップロード後公開されたデータ

https://www.mapillary.com/app/?lat=43.768171785529&lng=11.253255743011&z=17&pKey=536322358546361&focus=photo&x=0.5016456381446478&y=0.5228810357200745&zoom=0

mapconcierge commented 1 year ago

MEMO:

mapconcierge commented 1 year ago

2FPV でフレーム処理する場合の引数

--video_sample_interval=0.5

コマンド例

% mapillary_tools video_process "." --geotag_source "camm" --video_sample_interval=0.5

実行例ログ

taichi@taichinmbp15848 Movies % cd 360_shibuya20230107shibuyastation1500mapconcierge01thx01 
taichi@taichinmbp15848 360_shibuya20230107shibuyastation1500mapconcierge01thx01 % ls
R0023328.MP4                R0023331.MP4                R0023333.MP4
R0023330.MP4                R0023332.MP4                mapillary_sampled_video_frames_2sec

taichi@taichinmbp15848 360_shibuya20230107shibuyastation1500mapconcierge01thx01 % mapillary_tools video_process "." --geotag_source "camm" --video_sample_interval=0.5 
2023-01-11 23:10:19,748 - INFO    - Extracting video information: ffprobe -print_format json -hide_banner -show_format -show_streams R0023328.MP4
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x131604ca0] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x131604ca0] DTS discontinuity in stream 2: packet 362 with DTS 897157406, packet 363 with DTS 902140625
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0023328.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2023-01-07T05:41:50.000000Z
    com.apple.quicktime.location.ISO6709: +35.6576+139.7010+0076/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:05:02.79, start: 0.000000, bitrate: 16581 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 255 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T05:41:50.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Main) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16118 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2023-01-07T05:41:50.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 573099 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T05:41:50.000000Z
      handler_name    : CameraMetadataMotionHandler
Unsupported codec with id 0 for input stream 2
2023-01-11 23:10:20,553 - INFO    - Extracting frames: ffmpeg -i R0023328.MP4 -vf fps=1/0.5 -hide_banner -qscale:v 1 -nostdin /Users/taichi/Movies/360_shibuya20230107shibuyastation1500mapconcierge01thx01/mapillary_sampled_video_frames/.mly_ffmpeg_R0023328.MP4.1798.1673446220/R0023328_%06d.jpg
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x12df04190] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x12df04190] DTS discontinuity in stream 2: packet 362 with DTS 897157406, packet 363 with DTS 902140625
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0023328.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2023-01-07T05:41:50.000000Z
    com.apple.quicktime.location.ISO6709: +35.6576+139.7010+0076/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:05:02.79, start: 0.000000, bitrate: 16581 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 255 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T05:41:50.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Main) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16118 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2023-01-07T05:41:50.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 573099 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T05:41:50.000000Z
      handler_name    : CameraMetadataMotionHandler
Stream mapping:
  Stream #0:1 -> #0:0 (h264 (native) -> mjpeg (native))
Output #0, image2, to '/Users/taichi/Movies/360_shibuya20230107shibuyastation1500mapconcierge01thx01/mapillary_sampled_video_frames/.mly_ffmpeg_R0023328.MP4.1798.1673446220/R0023328_%06d.jpg':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    model           : RICOH THETA X
    com.apple.quicktime.location.ISO6709: +35.6576+139.7010+0076/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    encoder         : Lavf59.27.100
  Stream #0:0(eng): Video: mjpeg, yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840 [SAR 1:1 DAR 2:1], q=2-31, 200 kb/s, 2 fps, 2 tbn (default)
    Metadata:
      creation_time   : 2023-01-07T05:41:50.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
      encoder         : Lavc59.37.100 mjpeg
    Side data:
      cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: N/A
      spherical: equirectangular (0.000000/0.000000/0.000000) 
frame=  605 fps= 27 q=1.0 Lsize=N/A time=00:05:02.50 bitrate=N/A speed=13.3x    
video:1163945kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
2023-01-11 23:10:45,515 - INFO    - Extracting video information: ffprobe -print_format json -hide_banner -show_format -show_streams R0023332.MP4
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x12ce04ca0] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x12ce04ca0] DTS discontinuity in stream 2: packet 358 with DTS 887307719, packet 359 with DTS 892291563
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0023332.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2023-01-07T06:09:43.000000Z
    com.apple.quicktime.location.ISO6709: +35.6573+139.7006+0078/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:05:02.20, start: 0.000000, bitrate: 16532 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 256 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T06:09:43.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Main) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16069 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2023-01-07T06:09:43.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 573014 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T06:09:43.000000Z
      handler_name    : CameraMetadataMotionHandler
Unsupported codec with id 0 for input stream 2
2023-01-11 23:10:45,740 - INFO    - Extracting frames: ffmpeg -i R0023332.MP4 -vf fps=1/0.5 -hide_banner -qscale:v 1 -nostdin /Users/taichi/Movies/360_shibuya20230107shibuyastation1500mapconcierge01thx01/mapillary_sampled_video_frames/.mly_ffmpeg_R0023332.MP4.1798.1673446245/R0023332_%06d.jpg
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x149f04080] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x149f04080] DTS discontinuity in stream 2: packet 358 with DTS 887307719, packet 359 with DTS 892291563
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0023332.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2023-01-07T06:09:43.000000Z
    com.apple.quicktime.location.ISO6709: +35.6573+139.7006+0078/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:05:02.20, start: 0.000000, bitrate: 16532 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 256 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T06:09:43.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Main) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16069 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2023-01-07T06:09:43.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 573014 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T06:09:43.000000Z
      handler_name    : CameraMetadataMotionHandler
Stream mapping:
  Stream #0:1 -> #0:0 (h264 (native) -> mjpeg (native))
Output #0, image2, to '/Users/taichi/Movies/360_shibuya20230107shibuyastation1500mapconcierge01thx01/mapillary_sampled_video_frames/.mly_ffmpeg_R0023332.MP4.1798.1673446245/R0023332_%06d.jpg':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    model           : RICOH THETA X
    com.apple.quicktime.location.ISO6709: +35.6573+139.7006+0078/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    encoder         : Lavf59.27.100
  Stream #0:0(eng): Video: mjpeg, yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840 [SAR 1:1 DAR 2:1], q=2-31, 200 kb/s, 2 fps, 2 tbn (default)
    Metadata:
      creation_time   : 2023-01-07T06:09:43.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
      encoder         : Lavc59.37.100 mjpeg
    Side data:
      cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: N/A
      spherical: equirectangular (0.000000/0.000000/0.000000) 
frame=  604 fps= 26 q=1.0 Lsize=N/A time=00:05:02.00 bitrate=N/A speed=13.1x    
video:1194754kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
2023-01-11 23:11:11,139 - INFO    - Extracting video information: ffprobe -print_format json -hide_banner -show_format -show_streams R0023333.MP4
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x157704680] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x157704680] DTS discontinuity in stream 2: packet 354 with DTS 877362072, packet 355 with DTS 882346124
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0023333.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2023-01-07T06:13:01.000000Z
    com.apple.quicktime.location.ISO6709: +35.6579+139.7002+0077/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:03:11.17, start: 0.000000, bitrate: 16515 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 255 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T06:13:01.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Main) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16056 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2023-01-07T06:13:01.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 572896 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T06:13:01.000000Z
      handler_name    : CameraMetadataMotionHandler
Unsupported codec with id 0 for input stream 2
2023-01-11 23:11:11,393 - INFO    - Extracting frames: ffmpeg -i R0023333.MP4 -vf fps=1/0.5 -hide_banner -qscale:v 1 -nostdin /Users/taichi/Movies/360_shibuya20230107shibuyastation1500mapconcierge01thx01/mapillary_sampled_video_frames/.mly_ffmpeg_R0023333.MP4.1798.1673446271/R0023333_%06d.jpg
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x11df04080] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x11df04080] DTS discontinuity in stream 2: packet 354 with DTS 877362072, packet 355 with DTS 882346124
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0023333.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2023-01-07T06:13:01.000000Z
    com.apple.quicktime.location.ISO6709: +35.6579+139.7002+0077/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:03:11.17, start: 0.000000, bitrate: 16515 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 255 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T06:13:01.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Main) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16056 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2023-01-07T06:13:01.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 572896 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T06:13:01.000000Z
      handler_name    : CameraMetadataMotionHandler
Stream mapping:
  Stream #0:1 -> #0:0 (h264 (native) -> mjpeg (native))
Output #0, image2, to '/Users/taichi/Movies/360_shibuya20230107shibuyastation1500mapconcierge01thx01/mapillary_sampled_video_frames/.mly_ffmpeg_R0023333.MP4.1798.1673446271/R0023333_%06d.jpg':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    model           : RICOH THETA X
    com.apple.quicktime.location.ISO6709: +35.6579+139.7002+0077/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    encoder         : Lavf59.27.100
  Stream #0:0(eng): Video: mjpeg, yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840 [SAR 1:1 DAR 2:1], q=2-31, 200 kb/s, 2 fps, 2 tbn (default)
    Metadata:
      creation_time   : 2023-01-07T06:13:01.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
      encoder         : Lavc59.37.100 mjpeg
    Side data:
      cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: N/A
      spherical: equirectangular (0.000000/0.000000/0.000000) 
frame=  382 fps= 27 q=1.0 Lsize=N/A time=00:03:11.00 bitrate=N/A speed=13.4x    
video:651509kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
2023-01-11 23:11:27,049 - INFO    - Extracting video information: ffprobe -print_format json -hide_banner -show_format -show_streams R0023331.MP4
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x12c704680] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x12c704680] DTS discontinuity in stream 2: packet 358 with DTS 887264385, packet 359 with DTS 892247968
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0023331.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2023-01-07T06:04:27.000000Z
    com.apple.quicktime.location.ISO6709: +35.6573+139.7008+0049/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:05:01.66, start: 0.000000, bitrate: 16505 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 256 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T06:04:27.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Main) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16041 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2023-01-07T06:04:27.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 569315 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T06:04:27.000000Z
      handler_name    : CameraMetadataMotionHandler
Unsupported codec with id 0 for input stream 2
2023-01-11 23:11:27,275 - INFO    - Extracting frames: ffmpeg -i R0023331.MP4 -vf fps=1/0.5 -hide_banner -qscale:v 1 -nostdin /Users/taichi/Movies/360_shibuya20230107shibuyastation1500mapconcierge01thx01/mapillary_sampled_video_frames/.mly_ffmpeg_R0023331.MP4.1798.1673446287/R0023331_%06d.jpg
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x144004080] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x144004080] DTS discontinuity in stream 2: packet 358 with DTS 887264385, packet 359 with DTS 892247968
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0023331.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2023-01-07T06:04:27.000000Z
    com.apple.quicktime.location.ISO6709: +35.6573+139.7008+0049/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:05:01.66, start: 0.000000, bitrate: 16505 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 256 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T06:04:27.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Main) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16041 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2023-01-07T06:04:27.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 569315 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T06:04:27.000000Z
      handler_name    : CameraMetadataMotionHandler
Stream mapping:
  Stream #0:1 -> #0:0 (h264 (native) -> mjpeg (native))
Output #0, image2, to '/Users/taichi/Movies/360_shibuya20230107shibuyastation1500mapconcierge01thx01/mapillary_sampled_video_frames/.mly_ffmpeg_R0023331.MP4.1798.1673446287/R0023331_%06d.jpg':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    model           : RICOH THETA X
    com.apple.quicktime.location.ISO6709: +35.6573+139.7008+0049/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    encoder         : Lavf59.27.100
  Stream #0:0(eng): Video: mjpeg, yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840 [SAR 1:1 DAR 2:1], q=2-31, 200 kb/s, 2 fps, 2 tbn (default)
    Metadata:
      creation_time   : 2023-01-07T06:04:27.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
      encoder         : Lavc59.37.100 mjpeg
    Side data:
      cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: N/A
      spherical: equirectangular (0.000000/0.000000/0.000000) 
frame=  603 fps= 26 q=1.0 Lsize=N/A time=00:05:01.50 bitrate=N/A speed=12.8x    
video:1166292kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
2023-01-11 23:11:53,248 - INFO    - Extracting video information: ffprobe -print_format json -hide_banner -show_format -show_streams R0023330.MP4
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x148704680] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x148704680] DTS discontinuity in stream 2: packet 360 with DTS 892180688, packet 361 with DTS 897163906
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0023330.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2023-01-07T05:59:11.000000Z
    com.apple.quicktime.location.ISO6709: +35.6584+139.7006+0093/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:03:07.99, start: 0.000000, bitrate: 16541 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 256 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T05:59:11.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Main) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16067 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2023-01-07T05:59:11.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 573091 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T05:59:11.000000Z
      handler_name    : CameraMetadataMotionHandler
Unsupported codec with id 0 for input stream 2
2023-01-11 23:11:53,483 - INFO    - Extracting frames: ffmpeg -i R0023330.MP4 -vf fps=1/0.5 -hide_banner -qscale:v 1 -nostdin /Users/taichi/Movies/360_shibuya20230107shibuyastation1500mapconcierge01thx01/mapillary_sampled_video_frames/.mly_ffmpeg_R0023330.MP4.1798.1673446313/R0023330_%06d.jpg
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x138f04080] UDTA parsing failed retrying raw
    Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x138f04080] DTS discontinuity in stream 2: packet 360 with DTS 892180688, packet 361 with DTS 897163906
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'R0023330.MP4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2023-01-07T05:59:11.000000Z
    com.apple.quicktime.location.ISO6709: +35.6584+139.7006+0093/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    model           : RICOH THETA X
  Duration: 00:03:07.99, start: 0.000000, bitrate: 16541 kb/s
  Stream #0:0[0x1](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 256 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T05:59:11.000000Z
      handler_name    : SoundHandle
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (Main) (avc1 / 0x31637661), yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840, 16067 kb/s, SAR 1:1 DAR 2:1, 2 fps, 2 tbr, 90k tbn (default)
    Metadata:
      creation_time   : 2023-01-07T05:59:11.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
    Side data:
      spherical: equirectangular (0.000000/0.000000/0.000000) 
  Stream #0:2[0x3](und): Data: none (camm / 0x6D6D6163), 573091 kb/s (default)
    Metadata:
      creation_time   : 2023-01-07T05:59:11.000000Z
      handler_name    : CameraMetadataMotionHandler
Stream mapping:
  Stream #0:1 -> #0:0 (h264 (native) -> mjpeg (native))
Output #0, image2, to '/Users/taichi/Movies/360_shibuya20230107shibuyastation1500mapconcierge01thx01/mapillary_sampled_video_frames/.mly_ffmpeg_R0023330.MP4.1798.1673446313/R0023330_%06d.jpg':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    model           : RICOH THETA X
    com.apple.quicktime.location.ISO6709: +35.6584+139.7006+0093/
    com.apple.quicktime.make: RICOH
    com.apple.quicktime.model: RICOH THETA X
    make            : RICOH
    encoder         : Lavf59.27.100
  Stream #0:0(eng): Video: mjpeg, yuvj420p(pc, bt470bg/bt709/smpte170m, progressive), 7680x3840 [SAR 1:1 DAR 2:1], q=2-31, 200 kb/s, 2 fps, 2 tbn (default)
    Metadata:
      creation_time   : 2023-01-07T05:59:11.000000Z
      handler_name    : VideoHandle
      vendor_id       : [0][0][0][0]
      encoder         : Lavc59.37.100 mjpeg
    Side data:
      cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: N/A
      spherical: equirectangular (0.000000/0.000000/0.000000) 
frame=  376 fps= 26 q=1.0 Lsize=N/A time=00:03:08.00 bitrate=N/A speed=13.2x    
video:726745kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
Interpolating R0023328.MP4: 100%|█████████████████████████████████████████████████████████████████████████████████████████████| 605/605 [00:00<00:00, 5548.82images/s]
Interpolating R0023332.MP4: 100%|█████████████████████████████████████████████████████████████████████████████████████████████| 604/604 [00:00<00:00, 5662.01images/s]
Interpolating R0023333.MP4: 100%|█████████████████████████████████████████████████████████████████████████████████████████████| 382/382 [00:00<00:00, 5564.44images/s]
Interpolating R0023331.MP4: 100%|█████████████████████████████████████████████████████████████████████████████████████████████| 603/603 [00:00<00:00, 8883.55images/s]
Interpolating R0023330.MP4: 100%|████████████████████████████████████████████████████████████████████████████████████████████| 376/376 [00:00<00:00, 17875.82images/s]
Test EXIF writing: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████| 2526/2526 [00:04<00:00, 581.15images/s]
2023-01-11 23:12:39,937 - INFO    - Check the image description file for details: mapillary_sampled_video_frames/mapillary_image_description.json
2023-01-11 23:12:39,938 - INFO    -     2570 images read in total
2023-01-11 23:12:39,938 - INFO    -     2526 images processed and ready to be uploaded
2023-01-11 23:12:39,938 - WARNING -       26 images skipped due to MapillaryDuplicationError
2023-01-11 23:12:39,938 - WARNING -       18 images failed due to MapillaryOutsideGPXTrackError
2023-01-11 23:12:39,938 - ERROR   - MapillaryProcessError: Failed to process 18 images. To skip these errors, specify --skip_process_errors

mapconcierge commented 1 year ago

v0.9.5 one-liner command test

$ mapillary_tools upload --file_types=camm .

taichi@taichinmbp15848 temp % pwd                                               
/Users/taichi/Movies/temp/temp
taichi@taichinmbp15848 temp % ls
R0023368.MP4

taichi@taichinmbp15848 temp % mapillary_tools upload --file_types=camm .        
Uploading CAMM R0023368.MP4 (1/1): 100%|███████████████████████████████████████████████████████████████████████████████████████████| 182M/182M [00:39<00:00, 4.83MB/s]
2023-01-18 14:01:27,853 - INFO    -        1  CAMM files uploaded
2023-01-18 14:01:27,853 - INFO    -    181.9M data in total
2023-01-18 14:01:27,854 - INFO    -    181.9M data uploaded
2023-01-18 14:01:27,854 - INFO    -     39.5s upload time

Sample .mp4 file has 24 sec

24 sec * 2FPS = 48 frame ?

When run with 24sec test data, only 6 frames were uploaded. That means 4FPS. https://www.mapillary.com/app/user/mapconcierge?focus=map&location=Japan&lat=35.80027660615701&lng=139.43759166666996&z=17&pKey=1326932144759702

mapconcierge commented 1 year ago

v0.9.5 のワンライナーコマンドテスト2

$ mapillary_tools upload --video_sample_interval=0.5 --file_types=camm .

mapconcierge commented 1 year ago

ffprobeがない場合のエラー

taichi@DRONEBIRD 360_chiyodaku20230122yaesu1800mapconcierge02thx02 % mapillary_tools video_process "." --geotag_source "camm" --video_sample_interval=0.5
2023-01-23 13:50:55,568 - INFO    - Extracting video information: ffprobe -print_format json -hide_banner -show_format -show_streams R0023399.MP4
2023-01-23 13:50:55,570 - ERROR   - MapillaryFFmpegNotFoundError: The ffprobe command "ffprobe" not found

PIPで個別にインストール

taichi@DRONEBIRD 360_chiyodaku20230122yaesu1800mapconcierge02thx02 % python3 -m pip install --upgrade ffprobe        
Collecting ffprobe
  Downloading ffprobe-0.5.zip (3.5 kB)
  Preparing metadata (setup.py) ... done
Installing collected packages: ffprobe
  DEPRECATION: ffprobe is being installed using the legacy 'setup.py install' method, because it does not have a 'pyproject.toml' and the 'wheel' package is not installed. pip 23.1 will enforce this behaviour change. A possible replacement is to enable the '--use-pep517' option. Discussion can be found at https://github.com/pypa/pip/issues/8559
  Running setup.py install for ffprobe ... done
Successfully installed ffprobe-0.5

furuhashilab / mapping

2022-08-27 THETA X 動画 2FPSモード + CAMM での Mapillary 撮影とデータアップロード MEMO #71

mapilary_tools を用いて複数mp4ファイルをまとめて変換処理しMapillaryにアップロードする作業ログ

関連情報

STEP0a: mapillary_tools 最新版インストール方法とログイン方法

Python3がインストールされていなければインストール

pipを用いたインストール

自分のMapillaryアカウントで認証（古橋のアカウント名は mapconcierge）

STEP0b: mapillary_tools 最新版アップデート方法

STEP1: 最初に、複数のmp4ファイルを一括してフレーム分解

STEP2: フレーム分解した大量のjpgファイルと、CAMMメタデータから生成した mapillary_image_description.json ファイルをセットで Mapillaryにアップロード

アップロード後公開されたデータ

2FPV でフレーム処理する場合の引数

コマンド例

実行例ログ

v0.9.5 one-liner command test

Sample .mp4 file has 24 sec

v0.9.5 のワンライナーコマンドテスト2

ffprobeがない場合のエラー