openfoodfacts / openfoodfacts-query

This extracts key product data from MongoDB into a Postgres database to speed up OFF
GNU Affero General Public License v3.0
0 stars 0 forks source link

bug: Can't import data that contains \u0000 characters #15

Closed john-gom closed 8 months ago

john-gom commented 8 months ago

What

Some PO data contains nul (\u0000) characters which PostgreSQL can't cope with

Steps to reproduce the behavior:

Performa full import. Offending product is the editor_tags on 4779030380333

Expected behavior

Characters that can't be loaded should be ignored