master-of-zen / Av1an

Cross-platform command-line AV1 / VP9 / HEVC / H264 encoding framework with per scene quality encoding
GNU General Public License v3.0
1.4k stars 147 forks source link

Encoder failed FRAME MISMATCH #734

Open jriker1 opened 1 year ago

jriker1 commented 1 year ago

I am using av1an 0.4.1 with the latest rav1e at the moment on a Ryzen 7950x with 64gb ram. Converting a 4k HDR10 Blueray using these commands:

av1an.exe --verbose -i <INPUT> -e rav1e --target-quality 95 --vmaf-path vmaf_4k_v0.6.1.json -v "--speed 1 --primaries BT2020 --transfer SMPTE2084 --matrix BT2020NCL --mastering-display=G(13250,34500)B(7500,3000)R(34000,16000)WP(15635,16450)L(40000000,50) --content-light=1242,436" --chunk-method lsmash --concat mkvmerge --pix-format yuv420p10le -o <OUTPUT>

I am seeing entries like the below:

WARN [av1an_core::broker] Encoder failed (on chunk 842): encoder crashed: exit code: 0 stdout: FRAME MISMATCH: chunk 842: 36/239 (actual/expected frames) stderr: ! Chromaticity coordinates will be trimmed to the range 0.0 to 1.0 (see AV1 spec sec. 6.7.4).

CPU Feature Level: AVX512ICL Using y4m decoder: 3840x2160p @ 24/1 fps, 4:2:0, 10-bit Encoding settings: keyint_min=12 keyint_max=240 quantizer=100 bitrate=0 min_quantizer=0 low_latency=false tune=Psychovisual rdo_lookahead_frames=40 multiref=true fast_deblock=false scene_detection_mode=Standard cdef=true lrf=true enable_timing_info=false min_block_size=4x4 max_block_size=64x64 encode_bottomup=true non_square_partition_max_threshold=64x64 reduced_tx_set=false tx_domain_distortion=false tx_domain_rate=false rdo_tx_decision=true prediction_modes=Complex-All fine_directional_intra=true include_near_mvs=true use_satd_subpel=true Using 1 tile

    encoded 1/239 frames, 0.013 fps, 11968.32 Kb/s, est: 5h 10m 11s, 14.21 MB, elapsed: 1m 18s
    encoded 2/239 frames, 0.017 fps, 8822.30 Kb/s, est: 3h 56m 34s, 10.47 MB, elapsed: 1m 59s
    encoded 3/239 frames, 0.025 fps, 5881.86 Kb/s, est: 2h 37m 7s, 6.98 MB, elapsed: 1m 59s
    encoded 4/239 frames, 0.031 fps, 4468.37 Kb/s, est: 2h 7m 38s, 5.30 MB, elapsed: 2m 10s
    encoded 5/239 frames, 0.038 fps, 3574.89 Kb/s, est: 1h 41m 43s, 4.24 MB, elapsed: 2m 10s
    encoded 6/239 frames, 0.035 fps, 3739.10 Kb/s, est: 1h 50m 24s, 4.44 MB, elapsed: 2m 50s
    encoded 7/239 frames, 0.041 fps, 3205.08 Kb/s, est: 1h 34m 15s, 3.80 MB, elapsed: 2m 50s
    encoded 8/239 frames, 0.044 fps, 2825.64 Kb/s, est: 1h 26m 50s, 3.35 MB, elapsed: 3m 0s
    encoded 9/239 frames, 0.050 fps, 2511.79 Kb/s, est: 1h 16m 52s, 2.98 MB, elapsed: 3m 0s
    encoded 10/239 frames, 0.045 fps, 2757.79 Kb/s, est: 1h 24m 39s, 3.27 MB, elapsed: 3m 41s
    encoded 11/239 frames, 0.050 fps, 2507.17 Kb/s, est: 1h 16m 38s, 2.98 MB, elapsed: 3m 41s
    encoded 12/239 frames, 0.052 fps, 2317.62 Kb/s, est: 1h 13m 7s, 2.75 MB, elapsed: 3m 51s
    encoded 13/239 frames, 0.056 fps, 2139.41 Kb/s, est: 1h 7m 12s, 2.54 MB, elapsed: 3m 51s
    encoded 14/239 frames, 0.051 fps, 2313.42 Kb/s, est: 1h 13m 3s, 2.75 MB, elapsed: 4m 32s
    encoded 15/239 frames, 0.055 fps, 2159.26 Kb/s, est: 1h 7m 53s, 2.56 MB, elapsed: 4m 32s
    encoded 16/239 frames, 0.057 fps, 2039.17 Kb/s, est: 1h 5m 43s, 2.42 MB, elapsed: 4m 42s
    encoded 17/239 frames, 0.060 fps, 1919.28 Kb/s, est: 1h 1m 35s, 2.28 MB, elapsed: 4m 43s
    encoded 18/239 frames, 0.056 fps, 2056.66 Kb/s, est: 1h 6m 21s, 2.44 MB, elapsed: 5m 24s
    encoded 19/239 frames, 0.059 fps, 1948.47 Kb/s, est: 1h 2m 35s, 2.31 MB, elapsed: 5m 24s
    encoded 20/239 frames, 0.060 fps, 1862.02 Kb/s, est: 1h 1m 0s, 2.21 MB, elapsed: 5m 34s
    encoded 21/239 frames, 0.063 fps, 1773.39 Kb/s, est: 57m 50s, 2.11 MB, elapsed: 5m 34s
    encoded 22/239 frames, 0.059 fps, 1886.99 Kb/s, est: 1h 1m 48s, 2.24 MB, elapsed: 6m 15s
    encoded 23/239 frames, 0.061 fps, 1804.99 Kb/s, est: 58m 51s, 2.14 MB, elapsed: 6m 15s
    encoded 24/239 frames, 0.062 fps, 1743.02 Kb/s, est: 57m 36s, 2.07 MB, elapsed: 6m 25s
    encoded 25/239 frames, 0.065 fps, 1673.34 Kb/s, est: 55m 3s, 1.99 MB, elapsed: 6m 25s
    encoded 26/239 frames, 0.061 fps, 1762.07 Kb/s, est: 58m 25s, 2.09 MB, elapsed: 7m 7s
    encoded 27/239 frames, 0.063 fps, 1696.85 Kb/s, est: 56m 0s, 2.01 MB, elapsed: 7m 8s
    encoded 28/239 frames, 0.064 fps, 1648.60 Kb/s, est: 55m 0s, 1.96 MB, elapsed: 7m 18s
    encoded 29/239 frames, 0.066 fps, 1591.79 Kb/s, est: 52m 52s, 1.89 MB, elapsed: 7m 18s
    encoded 30/239 frames, 0.063 fps, 1651.06 Kb/s, est: 55m 37s, 1.96 MB, elapsed: 7m 59s
    encoded 31/239 frames, 0.065 fps, 1597.83 Kb/s, est: 53m 34s, 1.90 MB, elapsed: 7m 59s
    encoded 32/239 frames, 0.065 fps, 1555.62 Kb/s, est: 52m 42s, 1.85 MB, elapsed: 8m 8s
    encoded 33/239 frames, 0.067 fps, 1508.51 Kb/s, est: 50m 52s, 1.79 MB, elapsed: 8m 8s
    encoded 34/239 frames, 0.066 fps, 1494.31 Kb/s, est: 51m 48s, 1.77 MB, elapsed: 8m 35s
    encoded 35/239 frames, 0.068 fps, 1451.65 Kb/s, est: 50m 4s, 1.72 MB, elapsed: 8m 35s
    encoded 36/239 frames, 0.068 fps, 1418.51 Kb/s, est: 49m 27s, 1.68 MB, elapsed: 8m 46s
    >  encoded 36/239 frames, 0.068 fps, 1418.51 Kb/s, est: 49m 27s, 1.68 MB, elapsed: 8m 46s
    >  ----------
    >  Key frame:             1 | avg QP:  43.00 | avg size:   62335 B
    >  Inter frame:          35 | avg QP: 127.51 | avg size:    5818 B
    >  Intra only frame:      0 | avg QP:   0.00 | avg size:       0 B
    >  Switching frame:       0 | avg QP:   0.00 | avg size:       0 B
    >  ----

source pipe stderr: Error: fwrite() call failed when writing frame: 36, plane: 0, errno: 22 Output 69 frames in 20.44 seconds (3.38 fps)

WARN [av1an_core::broker] Encoder failed (on chunk 841): encoder crashed: exit code: 0 stdout: FRAME MISMATCH: chunk 841: 47/238 (actual/expected frames) stderr: ! Chromaticity coordinates will be trimmed to the range 0.0 to 1.0 (see AV1 spec sec. 6.7.4).

CPU Feature Level: AVX512ICL Using y4m decoder: 3840x2160p @ 24/1 fps, 4:2:0, 10-bit Encoding settings: keyint_min=12 keyint_max=240 quantizer=100 bitrate=0 min_quantizer=0 low_latency=false tune=Psychovisual rdo_lookahead_frames=40 multiref=true fast_deblock=false scene_detection_mode=Standard cdef=true lrf=true enable_timing_info=false min_block_size=4x4 max_block_size=64x64 encode_bottomup=true non_square_partition_max_threshold=64x64 reduced_tx_set=false tx_domain_distortion=false tx_domain_rate=false rdo_tx_decision=true prediction_modes=Complex-All fine_directional_intra=true include_near_mvs=true use_satd_subpel=true Using 1 tile

    encoded 1/238 frames, 0.015 fps, 3650.69 Kb/s, est: 4h 24m 28s, 4.32 MB, elapsed: 1m 6s
    encoded 2/238 frames, 0.021 fps, 2674.37 Kb/s, est: 3h 5m 42s, 3.16 MB, elapsed: 1m 34s
    encoded 3/238 frames, 0.032 fps, 1783.23 Kb/s, est: 2h 3m 21s, 2.11 MB, elapsed: 1m 34s
    encoded 4/238 frames, 0.039 fps, 1362.53 Kb/s, est: 1h 39m 19s, 1.61 MB, elapsed: 1m 41s
    encoded 5/238 frames, 0.049 fps, 1090.21 Kb/s, est: 1h 19m 9s, 1.29 MB, elapsed: 1m 41s
    encoded 6/238 frames, 0.045 fps, 1346.88 Kb/s, est: 1h 26m 27s, 1.59 MB, elapsed: 2m 14s
    encoded 7/238 frames, 0.052 fps, 1154.61 Kb/s, est: 1h 13m 48s, 1.36 MB, elapsed: 2m 14s
    encoded 8/238 frames, 0.056 fps, 1034.45 Kb/s, est: 1h 8m 11s, 1.22 MB, elapsed: 2m 22s
    encoded 9/238 frames, 0.063 fps, 919.62 Kb/s, est: 1h 0m 22s, 1.09 MB, elapsed: 2m 22s
    encoded 10/238 frames, 0.056 fps, 1194.20 Kb/s, est: 1h 7m 47s, 1.41 MB, elapsed: 2m 58s
    encoded 11/238 frames, 0.062 fps, 1085.72 Kb/s, est: 1h 1m 22s, 1.28 MB, elapsed: 2m 58s
    encoded 12/238 frames, 0.064 fps, 1020.53 Kb/s, est: 58m 52s, 1.21 MB, elapsed: 3m 7s
    encoded 13/238 frames, 0.069 fps, 942.10 Kb/s, est: 54m 7s, 1.11 MB, elapsed: 3m 7s
    encoded 14/238 frames, 0.061 fps, 1184.95 Kb/s, est: 1h 0m 56s, 1.40 MB, elapsed: 3m 48s
    encoded 15/238 frames, 0.066 fps, 1106.02 Kb/s, est: 56m 38s, 1.31 MB, elapsed: 3m 48s
    encoded 16/238 frames, 0.067 fps, 1054.62 Kb/s, est: 55m 11s, 1.25 MB, elapsed: 3m 58s
    encoded 17/238 frames, 0.071 fps, 992.64 Kb/s, est: 51m 43s, 1.17 MB, elapsed: 3m 58s
    encoded 18/238 frames, 0.065 fps, 1162.25 Kb/s, est: 56m 29s, 1.37 MB, elapsed: 4m 37s
    encoded 19/238 frames, 0.068 fps, 1101.13 Kb/s, est: 53m 17s, 1.30 MB, elapsed: 4m 37s
    encoded 20/238 frames, 0.070 fps, 1057.76 Kb/s, est: 52m 3s, 1.25 MB, elapsed: 4m 46s
    encoded 21/238 frames, 0.073 fps, 1007.43 Kb/s, est: 49m 22s, 1.19 MB, elapsed: 4m 46s
    encoded 22/238 frames, 0.068 fps, 1105.16 Kb/s, est: 52m 36s, 1.31 MB, elapsed: 5m 21s
    encoded 23/238 frames, 0.072 fps, 1057.15 Kb/s, est: 50m 5s, 1.25 MB, elapsed: 5m 21s
    encoded 24/238 frames, 0.073 fps, 1023.08 Kb/s, est: 49m 6s, 1.21 MB, elapsed: 5m 30s
    encoded 25/238 frames, 0.076 fps, 982.20 Kb/s, est: 46m 55s, 1.16 MB, elapsed: 5m 30s
    encoded 26/238 frames, 0.071 fps, 1055.99 Kb/s, est: 49m 28s, 1.25 MB, elapsed: 6m 4s
    encoded 27/238 frames, 0.074 fps, 1016.92 Kb/s, est: 47m 25s, 1.20 MB, elapsed: 6m 4s
    encoded 28/238 frames, 0.075 fps, 988.96 Kb/s, est: 46m 32s, 1.17 MB, elapsed: 6m 12s
    encoded 29/238 frames, 0.078 fps, 954.89 Kb/s, est: 44m 43s, 1.13 MB, elapsed: 6m 12s
    encoded 30/238 frames, 0.074 fps, 1009.55 Kb/s, est: 46m 36s, 1.19 MB, elapsed: 6m 43s
    encoded 31/238 frames, 0.077 fps, 977.01 Kb/s, est: 44m 53s, 1.15 MB, elapsed: 6m 43s
    encoded 32/238 frames, 0.078 fps, 954.38 Kb/s, est: 44m 7s, 1.13 MB, elapsed: 6m 51s
    encoded 33/238 frames, 0.080 fps, 925.49 Kb/s, est: 42m 35s, 1.09 MB, elapsed: 6m 51s
    encoded 34/238 frames, 0.077 fps, 968.11 Kb/s, est: 44m 21s, 1.14 MB, elapsed: 7m 23s
    encoded 35/238 frames, 0.079 fps, 940.48 Kb/s, est: 42m 53s, 1.11 MB, elapsed: 7m 23s
    encoded 36/238 frames, 0.080 fps, 922.42 Kb/s, est: 42m 16s, 1.09 MB, elapsed: 7m 32s
    encoded 37/238 frames, 0.082 fps, 897.52 Kb/s, est: 40m 56s, 1.06 MB, elapsed: 7m 32s
    encoded 38/238 frames, 0.080 fps, 906.07 Kb/s, est: 41m 51s, 1.07 MB, elapsed: 7m 57s
    encoded 39/238 frames, 0.082 fps, 882.86 Kb/s, est: 40m 35s, 1.04 MB, elapsed: 7m 57s
    encoded 40/238 frames, 0.083 fps, 862.39 Kb/s, est: 39m 48s, 1.02 MB, elapsed: 8m 2s
    encoded 41/238 frames, 0.085 fps, 841.38 Kb/s, est: 38m 38s, 0.99 MB, elapsed: 8m 2s
    encoded 42/238 frames, 0.083 fps, 851.08 Kb/s, est: 39m 26s, 1.01 MB, elapsed: 8m 27s
    encoded 43/238 frames, 0.085 fps, 831.31 Kb/s, est: 38m 19s, 0.98 MB, elapsed: 8m 27s
    encoded 44/238 frames, 0.086 fps, 814.04 Kb/s, est: 37m 40s, 0.96 MB, elapsed: 8m 32s
    encoded 45/238 frames, 0.088 fps, 795.98 Kb/s, est: 36m 38s, 0.94 MB, elapsed: 8m 32s
    encoded 46/238 frames, 0.085 fps, 839.08 Kb/s, est: 37m 44s, 0.99 MB, elapsed: 9m 2s
    encoded 47/238 frames, 0.087 fps, 821.25 Kb/s, est: 36m 44s, 0.97 MB, elapsed: 9m 2s
    >  encoded 47/238 frames, 0.087 fps, 821.25 Kb/s, est: 36m 44s, 0.97 MB, elapsed: 9m 2s
    >  ----------
    >  Key frame:             1 | avg QP:  44.00 | avg size:   19014 B
    >  Inter frame:          46 | avg QP: 127.61 | avg size:    3956 B
    >  Intra only frame:      0 | avg QP:   0.00 | avg size:       0 B
    >  Switching frame:       0 | avg QP:   0.00 | avg size:       0 B
    >  ----

source pipe stderr: Error: fwrite() call failed when writing frame: 47, plane: 0, errno: 22 Output 80 frames in 23.55 seconds (3.40 fps)