Variable Rasterization Rate/eye-tracked foveated encoding

alvr-org / alvr-visionos

Experimental visionOS client for ALVR - SteamVR on Apple Vision Pro!

MIT License

393 stars 24 forks source link

Variable Rasterization Rate/eye-tracked foveated encoding #20

Open shinyquagsire23 opened 5 months ago

shinyquagsire23 commented 5 months ago

Relevant docs: https://developer.apple.com/documentation/compositorservices/4082136-cp_drawable_get_rasterization_ra https://developer.apple.com/documentation/metal/mtlrasterizationratemap

Current foveation is only in the center of the FOV, but it should be possible to move the fovea based on the rasterization maps. Needs investigation.

shinyquagsire23 commented 4 months ago

I dug around CompositorServices and as far as I can tell, not only do we not have eye tracking, we don't have foveated rasterization rate maps. Apple needs to implement one or the other for us to proceed with this feature.