search

hollowaykeanho / Upscaler

A consolidation of various compiled open-source AI image/video upscaling product for a working CLI friendly image and video upscaling program.
BSD 3-Clause "New" or "Revised" License
251 stars 20 forks source link

Error selecting an encoder #64

Open Luctia opened 7 months ago

Luctia commented 7 months ago

Question

How can I get rid of the Error selecting an encoder error?

Background

I'm trying to upscale an mp4 video, but keep getting an FFmpeg related error. Both FFmpeg and FFprobe are installed on my machine (Ubuntu). I have a 1080 graphics card. The workspace directory does get made, but the frames subdirectory is always empty.

Current Research Artifacts (COMPULSORY)

I obviously checked the docs here for a solution and couldn't find one. Then I went to Google, where I found some articles related to FFmpeg, but they all seemed to be for slightly different configurations. I saw a comment about having to install zlib1g-dev, but after doing this I get the same error.

Note that the error does not terminate the script. It happily continues "generating frames" that don't seem to actually exist (so I'm also wondering why it says [SUCCESS].

Attachment

This is my script:

#!/bin/sh
[...]/upscaler-v0.7.0/upscaler/start.cmd \
        --model upscayl-ultrasharp \
    --scale 4 \
        --format png \
    --input ./test.mp4 \
    --video

This is my log:

[ INFO    ] 

Upscale Model    : upscayl-ultrasharp
Upscale Scale    : 4
Model Max Scale  : unspecified
Upscale Format   : png
Input File       : ./test.mp4
Is Video Input   : Yes

Output Directory : .
Output Filename  : test
Output Suffix    : upscaled
Output Extension : mp4

[ INFO    ] Creating workspace...

[ INFO    ] 

Video Name     : test.mp4
Video Codec    : vp9
Audio Codec    : opus
Pixel Format   :  (empty means yet to determine)
Input Frame    : 640x480
Output Frame   :  (empty means yet to determine)

Frame Rate     : 25/1
90000/1
Total Frames   : 27532
Current Frame  : 0
[ INFO    ] Upscaling frame 0/27532...
ffmpeg version N-110223-gb18a9c2971 Copyright (c) 2000-2023 the FFmpeg developers
  built with gcc 11 (Ubuntu 11.3.0-1ubuntu1~22.04)
  configuration: --enable-nonfree --enable-cuda-nvcc --enable-libnpp --extra-cflags=-I/usr/local/cuda/include --extra-ldflags=-L/usr/local/cuda/lib64
  libavutil      58.  6.100 / 58.  6.100
  libavcodec     60.  9.100 / 60.  9.100
  libavformat    60.  4.101 / 60.  4.101
  libavdevice    60.  2.100 / 60.  2.100
  libavfilter     9.  5.100 /  9.  5.100
  libswscale      7.  2.100 /  7.  2.100
  libswresample   4. 11.100 /  4. 11.100
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x55741957d180] stream 0, timescale not set
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x55741957d180] Could not find codec parameters for stream 2 (Video: png, none): unspecified size
Consider increasing the value for the 'analyzeduration' (0) and 'probesize' (5000000) options
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from './test.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2mp41
    title           : Title
    artist          : Artist
    date            : 20220216
    encoder         : Lavf60.18.100
    comment         : comment
  Duration: 00:18:21.32, start: 0.000000, bitrate: 293 kb/s
  Stream #0:0[0x1](eng): Video: vp9 (Profile 0) (vp09 / 0x39307076), yuv420p(tv, bt709), 640x480, 186 kb/s, SAR 1:1 DAR 4:3, 25 fps, 25 tbr, 16k tbn (default)
    Metadata:
      handler_name    : VideoHandler
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](nld): Audio: opus (Opus / 0x7375704F), 48000 Hz, stereo, fltp, 100 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
      vendor_id       : [0][0][0][0]
  Stream #0:2[0x0]: Video: png, none, 90k tbr, 90k tbn (attached pic)
[vost#0:0 @ 0x557419593200] Automatic encoder selection failed Default encoder for format image2 (codec png) is probably disabled. Please choose an encoder manually.
[vost#0:0 @ 0x557419593200] Error selecting an encoder
[0 NVIDIA GeForce GTX 1080]  queueC=2[8]  queueG=0[16]  queueT=1[2]
[0 NVIDIA GeForce GTX 1080]  bugsbn1=0  bugbilz=0  bugcopc=0  bugihfa=0
[0 NVIDIA GeForce GTX 1080]  fp16-p/s/a=1/1/0  int8-p/s/a=1/1/1
[0 NVIDIA GeForce GTX 1080]  subgroup=32  basic=1  vote=1  ballot=1  shuffle=1
[1 llvmpipe (LLVM 15.0.7, 256 bits)]  queueC=0[1]  queueG=0[1]  queueT=0[1]
[1 llvmpipe (LLVM 15.0.7, 256 bits)]  bugsbn1=0  bugbilz=0  bugcopc=0  bugihfa=0
[1 llvmpipe (LLVM 15.0.7, 256 bits)]  fp16-p/s/a=1/1/1  int8-p/s/a=1/1/1
[1 llvmpipe (LLVM 15.0.7, 256 bits)]  subgroup=8  basic=1  vote=1  ballot=1  shuffle=1
decode image ./test-upscaled_workspace/sample.png failed
./test-upscaled_workspace/frames/00.png: No such file or directory
./test-upscaled_workspace/frames/00.png: No such file or directory
rm: cannot remove './test-upscaled_workspace/sample.png': No such file or directory
[ SUCCESS ] frame 0/27532 upscaled.
hollowaykeanho commented 7 months ago

ffmpeg error. Looks like the ffmpeg failed to dissect the video. There is a test video in the repository, can you try test it out and revert back to me please?

If setup correctly, you only need to run this benchmark.cmd. That's our current way of testing whether the program is working on hardware configurations or otherwise.