search

Unity-Technologies / GenericFrameRecorder

This GitHub package is DEPRECATED. Please get the new Unity Recorder from the Asset Store (https://assetstore.unity.com/packages/essentials/unity-recorder-94079) Use the editor builtin Bug Reporter to report issues. You can track and vote for issues on the Issue Tracker (https://issuetracker.unity3d.com)
MIT License
534 stars 66 forks source link

Help with GenericFrameRecorder in VR #27

Open ghost opened 6 years ago

ghost commented 6 years ago

A couple of observations/questions

1) When in the VR session and recording, it made my view have quite pronounced jaggies and i could detect noticeable lag. 2) The resulting file has the video upside down 3) The video has a lot of artifacts, particularly at the beginning when i was moving my headset around - perhaps due to the headset and the capture resolution not being the same? 4) Why only GameDisplay and MainCamera? 5) If you have any suggestions for recording in a VR session I would like to hear them.

jasonm-unity commented 6 years ago

At the moment, VR is not officialy supported: no effort has been made to support it yet, but it's on the radar that is certain. That said:

  1. Not sure I understand your use of "lag" here? Frame rate slowdown? that would be to be expected as the current encoders and in series with the rendering, so they do affect fps.
  2. Flipped video? this is a know issue that I'm currently trying to track down...
  3. Artifacts: when using MP4, boost the bitrate in the encoding section of the recorders settings.
  4. GamePlay and MainCamera cover most cases for an initial beta release. that selection is scheduled to be expanded in the future.
  5. Not really, as I've yet to investigate that sub-set.
ghost commented 6 years ago

Hi Thanks for replying.

1) Yes. Framerate slow down (maybe dropped frames I am not sure). I also noticed stair stepping on the models like the resolution was reduced. 2) Yes flipped (upside down) 3, 4 and 5 ) Ok

Be interested in your feedback once you have a chance to test it out

jasonm-unity commented 6 years ago

for the flipped output, did you try the "flip" setting?

as for vr, it's definitely on the list of things coming.

jasonm-unity commented 6 years ago

could you try the latest released package (0.2.0.0027). It add support for VR and there is bug fix for vertical flipped out. there is still a situation where the output gets flipped, but its rare now.

MatiasBrunacci commented 6 years ago

@jasonm-unity Hi! I just tried the recorder 0.2.0027 (current) released Dec 20, 2017 with Unity 2017.3.0f3 (64-bit). I'm using a HTC Vive with LeapMotion sdk 4.3.3 and I notice the exact same problems that @rgjones33 commented before like the flip video, lot of artifacts, pronounced jaggies, etc. I'm running Windows 10 on a nice VR ready pc. The video's output shape is also super weird, it has a rounded shape like a fisheye video. I've attached the settings that i'm using and the raw video i'm getting as a result. I also notice that after recording 60 frames, the record start to slow down A LOT, like 3 fps per second (the result is a lot of lag that you can see in the very end of the video that i attached. I would love to record stuff directly inside Unity, please let me know if you have new improvements. I'm using Unity's latest version only because of this recorder.

capture29

..... o shit, i can't upload videos, i'll upload an image then. capture30

jasonm-unity commented 6 years ago

Have you tried the "360 view" collection method? it's geared for VR output. you can have it in stereo or not...

MatiasBrunacci commented 6 years ago

@jasonm-unity i don't have the "360 view" option, or i can't find it. But i solved the fisheye problem choosing "collection method: screen".

jasonm-unity commented 6 years ago

my bad, I miss read what version of of Unity you are using. 360 video support comes with 2018.1 which is in early alpha at the moment. So, unfortunately, the Recorder wont be of any help to you in pre 2018.1.