Access and share entire PC desktop in videogame

[stephensamonte]

Changes:

• Access and share entire PC desktop in video game

[stephensamonte]

Similar concept:

• bigscreenvr
• played-overwatch-vr-using-bigscreen
• bigscreen-lets-you-share-use-your-entire-pc-desktop-inside-vr

[stephensamonte]

on Unity:

• here_is_unity_code_to_capture_individual_windows
• ive_been_working_on_a_program_that_lets_you_have

[stephensamonte]

Unity accessing desktop hackathon project:

• AR Screen hackathon project

They mention "win32 calls" to actually control the local windows computer. Maybe I should be looking that up.

[stephensamonte]

Unity:

• stream-desktop-to-in-game-object.417859
• solved-windows-transparent-window-with-opaque-contents-lwa_colorkey
• viewing-desktop-in-scene

[stephensamonte]

Unreal Engine: Getting Computer Desktop In-Game

[stephensamonte]

Since there doesn't seem to be a way to display local computer in the virtual world, I'm not looking into C++ with Unreal Enigne:

• Introduction to C++ Programming in UE4

[stephensamonte]

Architecture would be:

• Create actor that has access to C++ functions
• in c++ capture the local computer screen as pixels and stream them as a texture

Texture Streaming Documentation

Unreal Engine Media Component. I believe we can swap the source to display stream from c++ Play a Video Stream

[stephensamonte]

Tutorial UE4 - Change material color in C++

We can render pixels on a texture canvas from blueprings: Write Pixel via Blueprint to exact positions in Canvas RenderTarget/Texture (Unreal Engine 4.14)

Draw material to canvas: Introduction to Render Targets - Unreal Engine 4 Tech Art S03E02

[stephensamonte]

Windows API to capture desktop: Screen capturing the desktop while excluding a specific application

[stephensamonte]

** Important Unreal Windows Capture Plugin