fholger / vrperfkit

VR Performance Toolkit
Other
1.31k stars 53 forks source link

Dynamic Foveated Rendering (Eye Tracking) #69

Open InsaneGrox opened 2 years ago

InsaneGrox commented 2 years ago

The HTC Vive Pro Eye, HP Reverb G2 Omnicept, Varjo Aero, and all Pimax HMDs (assuming eye tracking module is installed) are all capable of eye tracking, I can't speak for the quality of the others but I did some mock-up testing with the Vive Pro Eye in Neos (using a pixelization shader tied to exclude roughly a 200 pixel radius around my eye tracking vector) and the eye tracking of that HMD is accurate enough to do dynamic foveated rendering without being too noticable (assuming even semi-decent anti-aliasing and the eyes aren't squinting too much), Future HMDs will also likely be including eye tracking so this would also be good for future-proofing.

fholger commented 2 years ago

I have no hardware capable of eye tracking, so this is not something I can currently work on, myself.