nuvention-web / ShareVR

ShareVR
http://sharevr.io/
4 stars 0 forks source link

[Unity] Optimize Render Capture Performance #27

Open chenchen2015 opened 7 years ago

chenchen2015 commented 7 years ago

Description This could be one of our core IP if we can get some decent progress. Currently, our capture pipeline involves the following steps:

  1. Render camera view to a RenderTexture
  2. Read pixels in the RenderTexture and store it into a Texture2D object
  3. Encode Texture2D into image or video

This is taking lots of valuable render time which significantly limits our performance. We are not alone in this issue. Lots of people have struggled to find a better solution in Unity. According to this blog post, there are some deep profiling and optimizations we could do, but it will probably take some time.

The bottom line, I believe if we can optimize our capture performance such that user could easily record a medium to high-quality video (>=720p, 24Hz) without noticeable framerate issue (>=75 FPS), our plugin will dominate the market.

chenchen2015 commented 7 years ago

Pipline stall problem fixed in SDK v0.2

Further optimization pending until we get any feedback from beta testers.