i use apache spark, scala and use gradle to build my app. for testing i need lzo codec installed...
i still run into th following error. any idea? the error is not directly related to this repo. but still i would like to know how to use lzo codec within my test
it seems spark.read.csv can still not read my .txt.lzo file:
error:
- Should load from raw data *** FAILED *** (739 milliseconds)
org.apache.spark.SparkException: Job aborted due to stage failure: Task 3 in stage 0.0 failed 1 times, most recent failure: Lost task 3.0 in stage 0.0 (TID 3, localhost, executor driver): java.lang.NumberFormatException: For input string: ":�:h}P~j09��}10827#��)80.02,�w0:45:5"�n+<�79<790127827391"
at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
hi,
i use apache spark, scala and use gradle to build my app. for testing i need lzo codec installed...
i still run into th following error. any idea? the error is not directly related to this repo. but still i would like to know how to use lzo codec within my test
i followed these steps: https://gist.github.com/zedar/c43cbc7ff7f98abee885
here is how i edited my build.gradle:
it seems spark.read.csv can still not read my .txt.lzo file: error: