search

yhat / pandasql

sqldf for pandas
MIT License
1.31k stars 184 forks source link

How to set text_factory to handle non ascii byte codes #62

Open javadba opened 6 years ago

javadba commented 6 years ago

For an input dataset with some international data i am seeing very slow performance and then the following error was emitted:

(sqlite3.ProgrammingError) You must not use 8-bit bytestrings unless you use a text_factory that can interpret 8-bit bytestrings (like text_factory = str) It is highly recommended that you instead just switch your application to Unicode strings. [SQL: u'INSERT INTO pkgdftail ...

Is there a configuration and/or workaround for this?

juancresc commented 6 years ago

the same here