In-game Runtime API - Githubissues

chyyran commented 8 years ago

Similar to how the Steam overlay works, I want to be able to overlay a browser instance over the emulators Snowflake launches. However, I'm not familiar with hooking code, let alone attempting to render it over an arbitrary surface hooked into a game. If anyone is familiar with this, let me know, it'd be a big help.

Resources

Core hook entry: https://github.com/SnowflakePowered/sabinokaku Hook impl: https://github.com/Reloaded-Project/Reloaded.Hooks Example impl of hooking FFXIV: https://github.com/goatcorp/Dalamud CEF hosting: https://github.com/Styr1x/Browsingway Example impl: https://github.com/Reloaded-Project/Reloaded-II In-process hosting: https://gitlab.com/kaminariss/nextui-plugin/ hooking input on linux: https://tronche.com/gui/x/xlib/event-handling/XSelectInput.html sharing resources between dx11/dx12: https://stackoverflow.com/questions/52869111/sharing-id3d11buffer-and-id3d12resource GL_EXT_memory_object_win32/GL_EXT_memory_object for OpenGL buffer sharing. May be possible to offprocess chrome, render CEF to texture then paint. KMT: https://www.khronos.org/registry/OpenGL/extensions/EXT/EXT_win32_keyed_mutex.txt https://www.intel.com/content/www/us/en/developer/articles/technical/sharing-surfaces-between-opencl-and-directx-11-on-intel-processor-graphics.html https://github.com/flightlessmango/MangoHud/blob/master/src/vulkan.cpp#L1581 https://blog.techlab-xe.net/post-5439/ vk ex: https://github.com/scenerygraphics/scenery/blob/master/src/main/kotlin/graphics/scenery/controls/Hololens.kt#L232

Todo

[x] DirectX 11
[x] OpenGL
[ ] DirectX 12 (xenia)
[ ] Vulkan

DX9 support probably not worth maintaining.

andres-asm commented 8 years ago

https://github.com/spazzarama/Direct3DHook

chyyran commented 8 years ago

I've looked into that, and actually got a Bitmap rendering on top of an arbitrary RetroArch instance, but I couldn't get CEF to initialize properly and render to it.

andres-asm commented 7 years ago

what do you mean with CEF?

chyyran commented 7 years ago

Chromium Embedded Framework, like the Steam Overlay

On Tue, Jul 4, 2017, 12:27 AM Andrés notifications@github.com wrote:

what do you mean with CEF?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/SnowflakePowered/snowflake/issues/235#issuecomment-312777570, or mute the thread https://github.com/notifications/unsubscribe-auth/AA9EN7-rg1GAQ3NXMWxwGNdlU3JD4sCHks5sKb8egaJpZM4JEC2z .

chyyran commented 7 years ago

To clarify: I need to be able to render the webpage through CEF on to the injected surface, and be able to pass input to the instance of CEF so that users can interact with the webpage. This will be used to build an ingame-UI framework of sorts, and be able to control launched applications through a socket interface/message passing/some other hacky method abstracted away.

The Steam Overlay is not built in CEF, but does allow rendering of a CEF instance when using the ingame web browser.

It doesn't have to be done in managed code (C#), but should be able to be invoked through some standard calling convention (so probably C).

iongion commented 6 years ago

Did you guys find a solution to this ?

chyyran commented 6 years ago

Haven't yet no, it hasn't been a priority for a while either. Although if I could get this working it would be really nice to have.

On Wed, Jan 10, 2018, 3:51 AM ionut stoica, notifications@github.com wrote:

Did you guys find a solution to this ?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/SnowflakePowered/snowflake/issues/235#issuecomment-356539211, or mute the thread https://github.com/notifications/unsubscribe-auth/AA9EN8xAVPnfoBIdNdbV_vPuPHGF3heOks5tJHocgaJpZM4JEC2z .