To ensure full compatibility with different languages that use different character sets, we need to ensure that all parts of the engine correctly support UTF-8. std::string does theoretically work with UTF-8, but due to my lack of experience in this area engine code has probably made some bad assumptions that only work correctly with ASCII. File I/O code has made no concessions for it. We should rectify these, and if possible write some helper code to make it easier to do things properly going forward.
To ensure full compatibility with different languages that use different character sets, we need to ensure that all parts of the engine correctly support UTF-8.
std::stringdoes theoretically work with UTF-8, but due to my lack of experience in this area engine code has probably made some bad assumptions that only work correctly with ASCII. File I/O code has made no concessions for it. We should rectify these, and if possible write some helper code to make it easier to do things properly going forward.