refactor: reduce usage of `fmt`

[qudix]

I can't change much else until the spdlog vcpkg port adds support for std::format