search

abronte / PysparkProxy

Seamlessly execute pyspark code on remote clusters
Other
4 stars 0 forks source link

DataFrame.show() with non ascii characters #27

Open abronte opened 5 years ago

abronte commented 5 years ago

DataFrame.show() errors out on the client side when trying to show non ascii characters. No error from the server side.

Exception: 'ascii' codec can't encode character u'\xd1' in position 1385: ordinal not in range(128)

Same error running toPandas() and trying to write out to a file.

pandas/_libs/writers.pyx in pandas._libs.writers.write_csv_rows()

UnicodeEncodeError: 'ascii' codec can't encode character u'\xd1' in position 5: ordinal not in range(128)