ondra-m / ruby-spark

Ruby wrapper for Apache Spark
MIT License
227 stars 29 forks source link

fix "Encoding::UndefinedConversionError: from ASCII-8BIT to UTF-8" #34

Closed gururuby closed 1 year ago

ondra-m commented 8 years ago

Please write an example when it failed.

gururuby commented 8 years ago

$sc.parallelize(["jjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjj"]) Encoding::UndefinedConversionError: "\x82" from ASCII-8BIT to UTF-8 This is the same error as here https://github.com/ondra-m/ruby-spark/issues/27

ondra-m commented 8 years ago

It works for me. What serializator do you user?

  $sc.default_serializer
gururuby commented 8 years ago

I use oj serializer

ondra-m commented 8 years ago

Please write full example with your configurations. Oj works for me.