Evaluate available 2D overlay options

[hnkb]

Options include:

• [ ] Embed HTML browser
  • [ ] CEF with off-screen rendering
  • [ ] Ultralight (see AppCore source for reference GPUDriver implementations for OpenGL and D3D)
  • [ ] sciter
• [ ] Use a third-party multi-platform 2D library
  • [ ] Skia
  • [ ] cairo (see this and this)
• [ ] Use custom simple Box model for layout and 2D object hierarchy, and implement a Direct2D implementation for now
  • How can we use this with OpenGL? On Windows, theoretically, we can draw Direct2D output to texture and use it in OpenGL. But what about other platforms? For OpenGL font support, also see this.
    • [ ] Use SVG, it might even be possible to use Direct2D native SVG support

HTML UI is excellent, but might be too slow (chromium DLL itself is many tens of megabytes large). Ultralight claims to be fast (must be tested), and is designed explicitly for our scenario, but its license is restrictive. So we may want to also check out a more generic CEF-based solution.

In case of slow performance from HTML renderer, we can also add a simple 2D language ourself, to be fast and reduce dependencies. This should not be very complex, because for more complex scenarios we always have a full-fledged HTML browser.

[hnkb]

If custom 2D objects is chosen, I will need to then create an issue with these steps:

• Hierarchy of Box objects, with optional absolute or relative sizing (and HTML-like auto-size?)
• Mouse hit-testing to send mouse events to correct box
• Keyboard focus for boxes
• Button
• Hyperlink
• TextBox
• Image with zoom / pan
• CSS-like attributes and animation

[hnkb]

Basic feedback I get from Ultralight and Sciter is that they are certainly fast enough and can be integrated into 3D pipeline. Sciter has a very liberal license and performs really well. It is also very easy to integrate into C++ and communicate with DOM from C++, but has some usability issues which limit its usefulness. Its DOM and CSS have some browser-incompatibilities and it has its own scripting language instead of Javascript. This means that there is little possibility of supporting both web and app from the same code base.

To achieve the best possible web/app harmony, I think it is best to provide an internal HTTP server in the C++ side to communicated with an otherwise web-like HTML DOM/CSS and this is probably easier achieved with Ultralight.

Don't forget that a third option also exists (how acceptable is it?) to have a complete web site with WebGL inside an electron instance.