problem with database charset with national characters

[Jimmi08]

I didn't notice this before because e107 frontend somehow managed this. But I use the same database with other CMS and I noticed this:

If I use national characters in e107 admin (German, Slovak) they are saved in database this way:

I checked:

If I insert data right in database,
e107 is not able to manage it.

Thanks

[Jimmi08]

Can't be this reason?

[Jimmi08]

Ok, I has used MariaDB 10. After export and import to MariaDB 5, it looks to work as should it be.

Server version: 5.5.53-MariaDB-1ubuntu0.14.04.1 - (Ubuntu)

Server version: 10.1.21-MariaDB-1~trusty - mariadb.org binary distribution

[tgtje]

After reading into these things, and combining and extraction of answers i would assume, it could be that while utf8mb4....is used for connection ...overall it seems that the collation for database and server ALSO (at least proposed) have these set as utf8mb4 (maybe charset too).. As mentioned it is a extraction of answers..if it realy is that way...(no testground).. also a (maybe pointer, but interesting : http://mysql.rjweb.org/doc.php/charcoll

[Jimmi08]

Confirmed with XAMPP for 7.0.15 / PHP 7.0.15. It uses Server version: 10.1.21-MariaDB - mariadb.org binary distribution Server charset: UTF-8 Unicode (utf8) Server connection collation: Database:

Table:

Data in phpmyadmin:

Data in e107:

[CaMer0n]

@Jimmi08 I haven't performed a fresh install yet, but I did take an existing install and run it on MariaDB10 and then post comments in the chatbox. See below:

I suspect your problem may be due to the charset(s) you are exporting/importing with.

[CaMer0n]

Fresh install of e107 on MariaDB10 - still no problem found. Posted Japanese via the admin > News area.

[Jimmi08]

Check please your database. Or try insert them in via phpmyadmin. If they are correct in db,they are wrong in e107. If you use only e107 edit, they are saved wrong in database, but frontend is correct. I used data from db version 5 and it was displayed wrong.

[CaMer0n]

Still no issue, if I paste Japanese directly into PHPMyadmin it displays correctly. If I post via e107's admin or chatbox it is stored correctly.

[Jimmi08]

Closing. I will open new issue this if this happens again.

[rica-carv]

I'm still havig this issue in parts of my theme, strangelly.... Haven't figured out how and why they happen only in that parts... I got all files saved on UTF-8 charset, and it still happens...