Open dumblob opened 8 years ago
There are some nice UTF-8 tests out there and after reading something about them, I got convinced we might leverage them in the Dao UTF-8 implementation. Example test is the file https://www.cl.cam.ac.uk/~mgk25/ucs/examples/UTF-8-test.txt . Other tests are on https://bitbucket.org/knight666/utf8rewind (maybe we could convert and run them automatically).
There are some nice UTF-8 tests out there and after reading something about them, I got convinced we might leverage them in the Dao UTF-8 implementation. Example test is the file https://www.cl.cam.ac.uk/~mgk25/ucs/examples/UTF-8-test.txt . Other tests are on https://bitbucket.org/knight666/utf8rewind (maybe we could convert and run them automatically).