search

databricks / spark-perf

Performance tests for Apache Spark
Apache License 2.0
379 stars 203 forks source link

Error when running tests: java.lang.NoSuchMethodError: joptsimple.ArgumentAcceptingOptionSpec.required() #81

Closed ravi9 closed 9 years ago

ravi9 commented 9 years ago

I get the following error when running tests. Proper classpath is not being set. Any suggestions are appreciated.

Exception in thread "main" java.lang.NoSuchMethodError: joptsimple.ArgumentAcceptingOptionSpec.required()Ljoptsimple/ArgumentAcceptingOptionSpec;
    at mllib.perf.PerfTest$$anonfun$addOptionsToParser$1.apply(PerfTest.scala:80)
    at mllib.perf.PerfTest$$anonfun$addOptionsToParser$1.apply(PerfTest.scala:79)
    at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
Exception in thread "main" java.lang.IllegalArgumentException: int is not a value type
    at joptsimple.internal.Reflection.findConverter(Reflection.java:66)
    at joptsimple.ArgumentAcceptingOptionSpec.ofType(ArgumentAcceptingOptionSpec.java:111)
    at mllib.perf.PerfTest$$anonfun$addOptionsToParser$3.apply(PerfTest.scala:86)

Thank you

ravi9 commented 9 years ago

I resolved it by passing --driver-class-path arg to the spark-submit. For example: --driver-class-path /path/to/mllib-perf-tests-assembly.jar