search

matomo-org / matomo-log-analytics

Import any kind of server logs in Matomo for powerful log analytics. Universal log file parsing and reporting.
https://matomo.org/log-analytics/
GNU General Public License v3.0
224 stars 118 forks source link

Emoji crashes log import #278

Open khassad opened 4 years ago

khassad commented 4 years ago

Hi, I run import_logs on my Nginx log files but unfortunately Emoji characters happens to crash the server import thread with an Error 500. I tracked down this to a failure Emoji or related characters. I tried to filter them out in the import_logs.py but it still crashes the server. Any chance Matomo 3 will become utf8 compliant ?

Thanks

Findus23 commented 4 years ago

Hi,

Any chance Matomo 3 will become utf8 compliant ?

Unfortunately no, as this would be a major breaking change. But Matomo 4 already has this change applied, so it should not be long until this is finally fixed once and for all.

see also https://github.com/matomo-org/matomo/pull/15618

khassad commented 4 years ago

Ok, thanks for the answer, how can I get to run the beta of 4.x ? In the meantime we started hacking a fix to remove the Emoji from log files and avoid the crashes, I can submit it when it's ready if you want ?