search

linkedin / dr-elephant

Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark
Apache License 2.0
1.35k stars 858 forks source link

PSOParamGeneratorTest test failure #341

Open andrijaperovic opened 6 years ago

andrijaperovic commented 6 years ago

Seeing the following test failure when running play_command $OPTS clean test compile dist: 

[info] Total for test com.linkedin.drelephant.mapreduce.fetchers.MapReduceFSFetcherHadoop2Test
[info] Finished in 0.0 seconds
[info] 5 tests, 0 failures, 0 errors
[error] Test com.linkedin.drelephant.tuning.PSOParamGeneratorTest.getParamsTest failed: Swarm size did not match expected:<3> but was:<0>
[error] Test com.linkedin.drelephant.tuning.PSOParamGeneratorTest.generateParamSetTest failed: java.lang.RuntimeException: java.lang.NullPointerException
[error]     at play.libs.Json.parse(Json.java:71)
[error]     at com.linkedin.drelephant.tuning.PSOParamGeneratorTest$2.run(PSOParamGeneratorTest.java:111)
[error]     at play.test.Helpers.running(Helpers.java:417)
[error]     at com.linkedin.drelephant.tuning.PSOParamGeneratorTest.generateParamSetTest(PSOParamGeneratorTest.java:79)
[error]     ...
[error] Caused by: java.lang.NullPointerException
[error]     at com.fasterxml.jackson.core.JsonFactory.createParser(JsonFactory.java:822)
[error]     at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2580)
[error]     at play.libs.Json.parse(Json.java:69)
[error]     ... 40 more
i-mine commented 6 years ago

I met the same problem,did you fix that?

akshayrai commented 6 years ago

This seems related to the latest Auto-tuning changes.

@arpang / @mkumar1984 , can you take a look and provide some thoughts on this?

arpang commented 6 years ago

I have created a pull request addressing this issue: https://github.com/linkedin/dr-elephant/pull/343

arpang commented 6 years ago

@skakker, please close this issue, it is resolved.