2020.06 release

[mosra]

Should have been 2019.12, but hey -- I took a (semi-)break and survived until 2020!

There's a ton of little things, so better list them so I don't forget:

• [x] Update copyright years everywhere (once pending PRs are merged) -- mosra/corrade@66c91d1d1da65032e9344d5bfae80ab0c02b0fb7, mosra/magnum@19e0e96d74f6652934747b67ab0d197078a2051c...
  • [x] Also on the website
• [x] Archive old changelogs so the page isn't longer than Big Tech EULAs
• [x] version.h / versionPlugins.h / versionExtras.h ... everywhere -- mosra/corrade@7e0c03d71d7d6b9647a1d20f2802b30bb431329e, mosra/magnum@293f092f144fd2362e57baad162c573a4d02a9da
• [x] update singles with latest stuff, redo header line count calcs with GCC / Clang 10
• [x] enable basis and meshoptimizer in homebrew packages -- mosra/homebrew-magnum@22217f976ddc6445af525e370f19c10e9c96be46
  • [x] do the same for imgui (needs also some automagic for detecting IMGUI_DIR that's bundled in the magnum-integration install location) -- mosra/magnum-integration@03f325769fcc4f1f464503d6f3c0e084f6198de3, mosra/homebrew-magnum@7fd472bed522d104fe8914acedf357e921171c19
  • [x] do the same for arch packages also -- mosra/magnum-plugins@1ac7a53b22af30ab5c7453f15412c665ed579d9c, mosra/magnum-integration@af5e7edfb68a654ea0654a196978e38d4d18e744, mosra/magnum-examples@5e49e4fe8fc12fa880eda35b5bdc870ac204dcfa
  • [x] do it for vcpkg too so https://github.com/microsoft/vcpkg/pull/10761 can be merged -- https://github.com/microsoft/vcpkg/pull/12211
• [x] make ImGuiIntegration work with cmake-enabled add_subdirectory'd imgui? https://github.com/rAum/magnum-integration/commit/d5e3dad27b238e8fda3b75f3ac518603c076cad3 postponed
• [x] fix Sdl2Application and Basis patches in vcpkg -- https://github.com/microsoft/vcpkg/pull/10158
  • [x] needs the rewritten OpenAL find module #402 :(
• [x] look at imgui in dynamic build (https://github.com/mosra/magnum-integration/issues/67) postponed
• [x] Install 3rd party cmake find modules along with Magnum, to magnum's own dir so they don't conflict (and then add this dir to module path so these are found) postponed,
• [x] Math::angle() returns NaN for similar vectors, fix similarly to https://github.com/mosra/magnum/blob/a78cdc21342c66be7c71c8476eb3f8ad5a146121/src/Magnum/Math/Quaternion.h#L178-L202 -- 498f4c59e1186a46cd8b30547d9383a68498a8a5
• [x] ImageData::pixels() etc. rely on strided array view included before the header -- forward-declare arrayCast to avoid that -- cd7d080fbde57923d69eef48574ac877684deab1
• [x] Fix std::strings being accidentally printed to debug as ResourceKey -- 2ba54b542c278bbe20a9da17d887f084982882b8
• [x] Fix BufferTexture crashes on macOS -- e97b04f66d1fda400b9af047384f0d1044fc9b30, 24cc971b1f43c61aa157228f6ea9916007ffb3cd
  • [x] There's yet another corner case when mixing textures and buffers because my state tracker doesn't have 100*18 fields for all texture types times all texture binding points FFS GL FFS -- 36f51e3116ebe484a6cdba006660816e2b828e02
• [x] This ResourceManager check should probably be <= https://github.com/mosra/magnum/blob/a2118730a38f4f77297bb84108978f01f8d875bd/src/Magnum/Resource.h#L288 -- 47e1106633d824218a2626259813686bd1fa92c5
• [x] Look into plugin directory issues when building against brew-installed magnum/plugins (make default PLUGIN_DIRECTORY setting empty and pick it up first) -- mosra/corrade@a119b35a2a86342e9718b7b4864561a04e1362b4, 4090a88c97453da45ba5dbdd70d715faf9b2f405
• [x] Make libPNG / libJPEG version mismatch checks in plugin code non-fatal (check with homebrew libjpeg and libjpeg-turbo to be sure) nope, keeping them fatal -- in case of libJPEG this is a decoding error which we can't skip, in case of libPNG we'd need to fake the version string, which would work against the API that's there in the first place
• [x] Update all apps to use RGBA framebuffer by default to avoid accidentally picking a RGB565 one (on Mac, Android) -- https://github.com/mosra/magnum-integration/issues/59, e6dc5be1af95d6df7ec542624483304bfbef0d4a
• [x] Move key/button/... enums to the base Application class to things like keyState(Key) are possible postponed as i don't have a good idea about the naming
• [x] Better CMake subproject usage docs
• [x] "Fix" Mac builds of homebrew-magnum because Homebrew is stupid -- mosra/homebrew-magnum@4a79ad44d4fb0116e3836bc0caf8d8af15ca99b2
  • It tries to do Py2->3 migration and fails, returning a non-zero code. "Solution" is to disable upgrading (uhhh). brew unlink python@2 (uhhh)
• [x] Integrate changes from https://build.opensuse.org/project/show/home:synnick and https://github.com/alkavan/magnum-rpm-specs-f28, mention in Community Features
• [x] Mention sequentity and https://github.com/fgoujeon/ternarii in Community Features a new Community Showcase Powered By Magnum page, along with other projects
• [x] integrate the raytracing example -- mosra/magnum-examples#76
• [x] integrate IcoImporter -- mosra/magnum-plugins#79
• [x] webgl releases of the two new physics examples + arcball
  • [x] fix them on weird HiDPI platforms -- https://github.com/mosra/magnum-examples/issues/74
• [x] Finish growable arrays (arbitrary insertion / deletion) postponed, #293
• [x] WM_DPICHANGED event on GLFW 3.3 & Windows (#243), check also Mac with multiple differently dense monitors postponed to #423
• [x] Use glfwGetWindowContentScale() for getting virtual DPI scaling on windows when we have GLFW 3.3+ at least (and make the original just physical (and also complain that glfw is too old when trying to use virtual on 3.2 and below)), but keep the original handling for Linux as it's also used in Sdl2App and many Linux distros still have just 3.2 -- 444b925b2a2b04ebd12e2683c40fff53397a6418
• [x] GlfwApplication seems to be firing viewportEvent() / WM_SIZE event on Windows long before the event loop gets entered (repro case -- move Configuration into the constructor), possible workaround would be to suppress the events before mainLoopIteration gets called partially worked around by ignoring the first-ever viewport event (c17f5a0340d61909d515438c49fefec891c7387b)
  • [x] needs a better fix (setting up the callback only after constructor ends), otherwise assert(false) in the constructor does the same -- 8af1f6a91e71c72f07ab00d481aa4684fe601723
• [x] Look into Android NDK r18+ on CMake 3.16 (#310)
  • [x] Also mosra/toolchains#10 (the rest of the patch is postponed)
  • [x] And mosra/toolchains#11 postponed
• [x] Finish MeshData rework (#371)
  • [x] Custom attribute import in TinyGltfImporter -- mosra/magnum-plugins@79910b43f4e8d7c19f7d14d3d950430767b59530
  • [x] Custom attribute import in StanfordImporter -- mosra/magnum-plugins@dc41fe80f279e31d7f8f444e6b71026c2a9ad88f
  • [x] KHR_mesh_quantization support in TinyGltfImporter (so we support all data types) -- mosra/magnum-plugins@80028f6f130a41015184de7a8195b9827f66874d
  • [x] KHR_texture_transform in TinyGltfImporter -- mosra/magnum-plugins@7345d789638edf39e9a7c062c27110ac2ffa75bc
  • [x] Add support for tangents & binormals -- f4bca9b51ec14a5ab26a770b21df6f9065f7b404
  • [x] Add Tangent attribute to spheroid and plane-like primitives -- 2a88a885c15b1f6302fb9ccdc09e1e1789b784f6, b16861693a213835446ef290a365f76eefea9dc4, 1b776e13bc427cd8d8274fadbd366178ee12dad9, a099a57464be42e151472442dd62feea52ba0189
  • [x] use in MeshTools::compile() -- 80c6fef7bff966f44f509c75846616ba5c1cdf5d
  • [x] Support in TinyGltfImporter -- mosra/magnum-plugins@1cc6b4e93d9600a7c4f65a69b5062ed33ad3e5cf
  • [x] Tangents and binormals in AssimpImporter -- mosra/magnum-plugins@1ed63e0a9a0ba782f545b8e70076d5fb39afc59c
  • [x] Tangent/bitangent generation using http://www.mikktspace.com/ postponed
  • [x] Add support for object ID attribs -- 8a2a7e4547832eff0aa8f16efec208707559a7b6
  • [x] use in MeshTools::compile() -- ea3bcb6d93012071192c495a2a12a2b0619ff41a
  • [x] Gather info about what attribute names are used in PLY (object_id) / glTF (_OBJECT_ID)
  • [x] Implement in StanfordImporter -- mosra/magnum-plugins@68e4fa513507afed1193e846a97fe583e5f8a489
  • [x] Implement in TinyGltfImporter -- mosra/magnum-plugins@b451b601ed30a372969cd3ca1ba1f6db00c47a02
• [x] MeshTools::owned(), MeshTools::reference() because concatenate() is not good for that, update all code that used it like that before -- fdb754bc27bb68ade5a4ba2b38f37319956fadc5
• [x] properly handle positions with stride % 4 != 0 in MeshOptimizer -- mosra/magnum-plugins@12c21322237e7b5a794de81b40596f7230758cfa
• [x] fixed border classification in meshoptimizer master could improve simplification artifacts? not really
• [x] Texture coordinate support in the cube primitive (one with a single texture for all faces, one with a center strip and two "ears" up and down, one packing six faces) potponed
• [x] Finish & merge mip level selection (#369)
  • [x] Adapt Assimp, Ogex, TinyGltf importers (I hope I have a branch with these)
• [x] Extend format support in DDS (https://github.com/mosra/magnum-plugins/pull/67) postponed as it needs the CompressedImage APIs to be aware of data sizes
  • [x] Make a BC6H converter plugin using something from #146 not really a priority anymore, postponed
  • [x] Make a DDS converter that can contain the BC6H data postponed, rather invest time into KTX2
• [x] Zero-copy import for gltf so we can operate on the data in-place (#240) -- just a MVP, glb only, as I need it for the dataset fixups postponed
  • [x] Needs CgltfImporter because tinygltf can't be helped :/ postponed
• [x] ~~A non-crappy TextureTools::atlas() (I have some links somewhere, don't remember where) -- with binary search that aims to fit into the smallest rectangle, plus trying a few sorting strategies, picking the one that fits best (don't need an incremental version yet, it's again just for the dataset fixups)~~ postponed, links saved to #143
• [x] mesh.draw(shader) -> shader.draw(mesh), also the xfb and MeshView version, deprecate the original -- 32d49db4028eccde901869e480bf1c9c275ccbca
• [x] exit(0); in Application constructor should exit immediately after constructor ends, not process events or other stuff (mainLoopIteration() returning false directly, basically), document that it's a clean way to exit (compared to std::exit()) and suggest return exit(0) -- #429, 2149e78f824c02d9a16d2580a6528a2dcf6dfc89
• [x] Make "globals shared across SOs" work for flextGL-generated function pointers in progress mosra/magnum@b580458104d5fbeaebb98ce8eff3323758c99957, postponed, apparently works only with pointers and i'm not sure of the cost of the additional indirection
• [x] Make the cone primitive properly smooth (how?!) postponed
• [x] expose the new features (normals, primitive / object ID visualization, ...) in magnum-player -- mosra/magnum-extras@07055d53d084ed9d3588c30917b6ce3537777bd8, mosra/magnum-extras@e50f8b82f58026ce19d8065979eb6d01a46723df, mosra/magnum-extras@e979de284bfedd447f8d863cc1bc3a1f0c75dda2
• [x] fix Math::cross() catastrophic cancellation according to https://pharr.org/matt/blog/2019/11/03/difference-of-floats.html postponed, https://github.com/mosra/magnum/pull/435
• [x] update basis plugins for UASTC support -- mosra/magnum-plugins#86 postponed, the new version crashes even on the most trivial tests
• [x] wrap up and integrate scene conversion plugins , meshlets and serialization from #427 -- https://blog.magnum.graphics/announcements/new-geometry-pipeline/

Stretch goals:

• [x] CUDA device selection in WindowlessEglApp so Habitat can throw away their implementation -- #449
• [x] Minimal instancing in Phong/Flat -- a1f1f66c04daaa32ee3153ac9a9c0ab8cf9dceb5, 55685ea382ac65171fcc2c7826c7cba9443708bf
  • [x] per-vertex object IDs
  • [x] Port physics examples to use instancing -- mosra/magnum-examples@6b55f43dcc9f078f12ca03a4012de7f0e28839b3
• [x] 2D MeshVisualizer shader
  • [x] which can also take texture coordinates of a 3D mesh and visualize the UV layout postponed
• [x] TBN and primitive visualization in MeshVisualizer
• [x] Outlier removal in DebugTools::CompareImage (also visualize those somehow .. with a box?) postponed
• [x] Aligned allocation (Utility/Memory.h, which could be used for stuff like magic ring buffers or non-reallocating arrays in the future also) postponed
• [x] printing just file info in magnum-imageconverter without doing anything else -- 92655c72384c8cb05bc6eedfd2759d9688712a8d
  • [x] and add a minimal sceneconverter with the same -- 1c51b98d76ed4ee74c7d73a5aa929139d6893ccf

[ytain]

Regarding TextureTools::atlas() there are two suggestions: https://github.com/juj/RectangleBinPack https://github.com/TeamHypersomnia/rectpack2D

And I wanted to bring you attention to additional stuff that might give you ideas later on the road: https://github.com/azhirnov/FrameGraph https://github.com/acdemiralp/fg Those two will assist more the Vulkan and OpenGL AZDO paths.

//Edit Forgot to mention also a serialization suggestion, header only https://github.com/USCiLab/cereal (of course you could ignore the xml and json part of the serialization, and I'm not sure if it's zero-copy). //Edit

Best regards

[mosra]

@ytain thank you! Yes, that thing from TeamHypersomnia is what I wanted to implement, as it's pretty small at its core.

Serialization (or its beginnings at least) will be done as part of #371. I really wanted to try something totally different here (with deserialization taking exactly 0 instructions), will see how it goes.

[aristotaloss]

This might be or not be a stretch, but it could be interesting: through MoltenVK you might be able to add Metal as a render target, making the iOS/Mac support better since Apple is now so heavily pushing Metal (even deprecating OpenGL). Just an idea - it would be really interesting since mobiles are our primary target and Magnum seems really great :)

[mosra]

@Velocity- That's the plan, in fact :) Though probably won't fit into this release, the list above is quite long already.

[alanjfs]

Powered By Magnum

You should have a logo printed up of that, happy to put that in the README of the project. ^__^

[ytain]

With regard to framegraph stuff that I mentioned in an earlier post of mine in this thread, you can see the benefits of using a framegraph approach to make a performant 3d engine.

Case in point, there's a graph showing which GPU states are expensive when changing:

https://computergraphics.stackexchange.com/questions/37/what-is-the-cost-of-changing-state/46#46

Best regards

[mosra]

:tada: All done, finally. Release notes here: https://blog.magnum.graphics/announcements/2020.06/