obsproject / obs-studio

OBS Studio - Free and open source software for live streaming and screen recording
https://obsproject.com
GNU General Public License v2.0
60.49k stars 8k forks source link

Recording 7680x2160 canvas with hevc_nvenc at 48 fps crashes when stopping recording #11341

Open akotulu opened 1 month ago

akotulu commented 1 month ago

Operating System Info

Windows 10

Other OS

No response

OBS Studio Version

30.2.3

OBS Studio Version (Other)

No response

OBS Studio Log URL

https://obsproject.com/logs/7xulqpaipgRABWlq

OBS Studio Crash Log URL

No response

Expected Behavior

Program will handle the overflow and continue working.

Current Behavior

Stopping recording crashes program.

Steps to Reproduce

  1. RTX 3090 24GB with Gaming Drivers
  2. Settings -> Video -> Base canvas of 7680x2160, output 7680x2160, FPS 48
  3. Output -> Recording -> Advanced -> Custom FFmpeg, Video Bitrate 1000000 Kbps, Keyframe 250, Encoder hevc_nvenc (show all), Encoder settings rc=vbr cq=13
  4. Record two monitors having 3840x2168 resolution (I have 4, driver has hardcoded max resolution)

Anything else we should know?

With previous Nvidia drivers (year ago), Task Manager displayed 89-90% encoder chip usage (card has dedicated chip for encoding and decoding). With latest drivers it now is impossible to record at 48FPS, lowering to 40 will work. But OBS is crashing after stopping recording @ 48FPS - Encoder chip usage is 99-100%

flaeri commented 1 month ago

I can replicate the crash by following your instructions.

Is the reason you are using custom ffmpeg outout access to VBR-CQ rate control? In the next OBS update there is an encoder update, which will give you access to this in the normal modes. You could jump on that early, if you wish. Hopefully there will be a beta quite soon if you'd rather wait for that.

Custom FFMPEG output is in a rough spot support wise, and there are plenty of variations that unfortunately do crash.