search

maajor / NeuralNetworkPostProcessing

Unity Post Processing with Convolution Neural Network
125 stars 18 forks source link

VR #1

Open andybak opened 5 years ago

andybak commented 5 years ago

So the good news is that this runs in VR without any modification.

Bad news is that it runs at 2fps on a GTX 1080 ;-)

My hunch is that reprojection would make this tolerable if we could hit 45fps.

So only a 20x speedup!

Supporting single pass rendering would probably buy a 1.5x speedup and might not be too hard. Rendering at half res would probably give a 4x speedup.

I haven't looked at the code. How much scope is there for something completely improbably like a 10x speedup through optimization? I'm guessing that's a fairly tall order.

maajor commented 5 years ago

Hi! Yes it true performance is a big issue right now. There are some ways

  1. Quantization, let all computation run in 8bit than 32bit, but I don't think compute shader can do that, maybe need to use OpenCL?
  2. Shallower network, for now it is around 30 layers, I can try train it with less layers.

Anyway thanks, I will take a look at it later.