I posted as a comment to this issue on a previously closed issue. Basically, still having a build issue for the 1.0.0-M01 branch. Is there a solution to this? My output is below.
cutor - Finished task 0.0 in stage 106.0 (TID 105). 1000 bytes result sent to driver
16:58:07.296 [Result resolver thread-1] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 106.0 (TID 105) in 87 ms on localhost (1/1)
16:58:07.296 [Result resolver thread-1] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 106.0, whose tasks have all completed, from pool
16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Stage 106 (map at ClassifierUtil.java:42) finished in 0.088 s
16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - looking for newly runnable stages
16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - running: Set()
16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - waiting: Set(Stage 103, Stage 107)
16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - failed: Set()
16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents for Stage 103: List(Stage 107)
16:58:07.298 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents for Stage 107: List()
16:58:07.298 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting Stage 107 (ShuffledRDD[211] at combineByKey at BinaryClassificationMetrics.scala:101), which is now runnable
16:58:07.298 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(2752) called with curMem=5161632, maxMem=997699092
16:58:07.298 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_207 stored as values in memory (estimated size 2.7 KB, free 946.6 MB)
16:58:07.299 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting 1 missing tasks from Stage 107 (ShuffledRDD[211] at combineByKey at BinaryClassificationMetrics.scala:101)
16:58:07.299 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.s.scheduler.TaskSchedulerImpl - Adding task set 107.0 with 1 tasks
16:58:07.299 [sparkDriver-akka.actor.default-dispatcher-2] INFO o.a.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 107.0 (TID 106, localhost, PROCESS_LOCAL, 937 bytes)
16:58:07.299 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 107.0 (TID 106)
16:58:07.300 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - maxBytesInFlight: 50331648, targetRequestSize: 10066329
16:58:07.300 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Getting 1 non-empty blocks out of 1 blocks
16:58:07.300 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Started 0 remote fetches in 0 ms
16:58:07.305 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 107.0 (TID 106). 1000 bytes result sent to driver
16:58:07.305 [Result resolver thread-2] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 107.0 (TID 106) in 6 ms on localhost (1/1)
16:58:07.305 [Result resolver thread-2] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 107.0, whose tasks have all completed, from pool
16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Stage 107 (combineByKey at BinaryClassificationMetrics.scala:101) finished in 0.006 s
16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - looking for newly runnable stages
16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - running: Set()
16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - waiting: Set(Stage 103)
16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - failed: Set()
16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents for Stage 103: List()
16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting Stage 103 (MapPartitionsRDD[214] at mapPartitions at BinaryClassificationMetrics.scala:106), which is now runnable
16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(3152) called with curMem=5164384, maxMem=997699092
16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_208 stored as values in memory (estimated size 3.1 KB, free 946.6 MB)
16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting 1 missing tasks from Stage 103 (MapPartitionsRDD[214] at mapPartitions at BinaryClassificationMetrics.scala:106)
16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.s.scheduler.TaskSchedulerImpl - Adding task set 103.0 with 1 tasks
16:58:07.307 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.a.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 103.0 (TID 107, localhost, PROCESS_LOCAL, 948 bytes)
16:58:07.307 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 103.0 (TID 107)
16:58:07.307 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - maxBytesInFlight: 50331648, targetRequestSize: 10066329
16:58:07.307 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Getting 1 non-empty blocks out of 1 blocks
16:58:07.307 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Started 0 remote fetches in 0 ms
16:58:07.320 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 103.0 (TID 107). 991 bytes result sent to driver
16:58:07.321 [Result resolver thread-3] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 103.0 (TID 107) in 15 ms on localhost (1/1)
16:58:07.321 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Stage 103 (collect at BinaryClassificationMetrics.scala:110) finished in 0.015 s
16:58:07.321 [Result resolver thread-3] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 103.0, whose tasks have all completed, from pool
16:58:07.321 [main] INFO org.apache.spark.SparkContext - Job finished: collect at BinaryClassificationMetrics.scala:110, took 0.284472139 s
16:58:07.323 [main] INFO o.a.s.m.e.BinaryClassificationMetrics - Total counts: {numPos: 31, numNeg: 43}
16:58:07.339 [main] INFO org.apache.spark.SparkContext - Starting job: runJob at SlidingRDD.scala:74
16:58:07.341 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.MapOutputTrackerMaster - Size of output statuses for shuffle 1 is 137 bytes
16:58:07.343 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.MapOutputTrackerMaster - Size of output statuses for shuffle 0 is 137 bytes
16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.MapOutputTrackerMaster - Size of output statuses for shuffle 3 is 137 bytes
16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.MapOutputTrackerMaster - Size of output statuses for shuffle 2 is 137 bytes
16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Got job 104 (runJob at SlidingRDD.scala:74) with 2 output partitions (allowLocal=true)
16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Final stage: Stage 108(runJob at SlidingRDD.scala:74)
16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Parents of final stage: List(Stage 112)
16:58:07.345 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents: List()
16:58:07.345 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting Stage 108 (UnionRDD[220] at UnionRDD at BinaryClassificationMetrics.scala:54), which has no missing parents
16:58:07.351 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(4968) called with curMem=5167536, maxMem=997699092
16:58:07.351 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_209 stored as values in memory (estimated size 4.9 KB, free 946.5 MB)
16:58:07.352 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting 2 missing tasks from Stage 108 (UnionRDD[220] at UnionRDD at BinaryClassificationMetrics.scala:54)
16:58:07.352 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.s.scheduler.TaskSchedulerImpl - Adding task set 108.0 with 2 tasks
16:58:07.352 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.a.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 108.0 (TID 108, localhost, PROCESS_LOCAL, 1057 bytes)
16:58:07.354 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.a.spark.scheduler.TaskSetManager - Starting task 1.0 in stage 108.0 (TID 109, localhost, PROCESS_LOCAL, 1401 bytes)
16:58:07.354 [Executor task launch worker-0] INFO org.apache.spark.executor.Executor - Running task 1.0 in stage 108.0 (TID 109)
16:58:07.355 [Executor task launch worker-0] INFO org.apache.spark.executor.Executor - Finished task 1.0 in stage 108.0 (TID 109). 723 bytes result sent to driver
16:58:07.356 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 108.0 (TID 108)
16:58:07.356 [Result resolver thread-0] INFO o.a.spark.scheduler.TaskSetManager - Finished task 1.0 in stage 108.0 (TID 109) in 4 ms on localhost (1/2)
16:58:07.356 [Executor task launch worker-1] INFO org.apache.spark.CacheManager - Partition rdd_215_0 not found, computing it
16:58:07.357 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - maxBytesInFlight: 50331648, targetRequestSize: 10066329
16:58:07.357 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Getting 1 non-empty blocks out of 1 blocks
16:58:07.357 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Started 0 remote fetches in 0 ms
16:58:07.361 [Executor task launch worker-1] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(6232) called with curMem=5172504, maxMem=997699092
16:58:07.362 [Executor task launch worker-1] INFO org.apache.spark.storage.MemoryStore - Block rdd_215_0 stored as values in memory (estimated size 6.1 KB, free 946.5 MB)
16:58:07.363 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.storage.BlockManagerInfo - Added rdd_215_0 in memory on 172.29.85.226:33829 (size: 6.1 KB, free: 946.8 MB)
16:58:07.363 [Executor task launch worker-1] INFO o.a.spark.storage.BlockManagerMaster - Updated info of block rdd_215_0
16:58:07.364 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 108.0 (TID 108). 1533 bytes result sent to driver
16:58:07.364 [Result resolver thread-1] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 108.0 (TID 108) in 12 ms on localhost (2/2)
16:58:07.364 [Result resolver thread-1] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 108.0, whose tasks have all completed, from pool
16:58:07.365 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Stage 108 (runJob at SlidingRDD.scala:74) finished in 0.011 s
16:58:07.365 [main] INFO org.apache.spark.SparkContext - Job finished: runJob at SlidingRDD.scala:74, took 0.025972716 s
16:58:07.366 [main] INFO org.apache.spark.SparkContext - Starting job: aggregate at AreaUnderCurve.scala:45
16:58:07.367 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Got job 105 (aggregate at AreaUnderCurve.scala:45) with 3 output partitions (allowLocal=false)
16:58:07.367 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Final stage: Stage 113(aggregate at AreaUnderCurve.scala:45)
16:58:07.367 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Parents of final stage: List(Stage 117)
16:58:07.368 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents: List()
16:58:07.369 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting Stage 113 (SlidingRDD[221] at RDD at SlidingRDD.scala:47), which has no missing parents
16:58:07.369 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(5216) called with curMem=5178736, maxMem=997699092
16:58:07.369 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_210 stored as values in memory (estimated size 5.1 KB, free 946.5 MB)
16:58:07.370 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting 3 missing tasks from Stage 113 (SlidingRDD[221] at RDD at SlidingRDD.scala:47)
16:58:07.371 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.s.scheduler.TaskSchedulerImpl - Adding task set 113.0 with 3 tasks
16:58:07.371 [sparkDriver-akka.actor.default-dispatcher-19] INFO o.a.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 113.0 (TID 110, localhost, PROCESS_LOCAL, 1805 bytes)
16:58:07.371 [sparkDriver-akka.actor.default-dispatcher-19] INFO o.a.spark.scheduler.TaskSetManager - Starting task 2.0 in stage 113.0 (TID 111, localhost, PROCESS_LOCAL, 1558 bytes)
16:58:07.371 [sparkDriver-akka.actor.default-dispatcher-19] INFO o.a.spark.scheduler.TaskSetManager - Starting task 1.0 in stage 113.0 (TID 112, localhost, ANY, 1599 bytes)
16:58:07.371 [Executor task launch worker-0] INFO org.apache.spark.executor.Executor - Running task 2.0 in stage 113.0 (TID 111)
16:58:07.371 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 113.0 (TID 110)
16:58:07.374 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 113.0 (TID 110). 625 bytes result sent to driver
16:58:07.376 [Executor task launch worker-0] INFO org.apache.spark.executor.Executor - Finished task 2.0 in stage 113.0 (TID 111). 625 bytes result sent to driver
16:58:07.377 [Executor task launch worker-2] INFO org.apache.spark.executor.Executor - Running task 1.0 in stage 113.0 (TID 112)
16:58:07.378 [Result resolver thread-2] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 113.0 (TID 110) in 7 ms on localhost (1/3)
16:58:07.379 [Result resolver thread-2] INFO o.a.spark.scheduler.TaskSetManager - Finished task 2.0 in stage 113.0 (TID 111) in 8 ms on localhost (2/3)
16:58:07.379 [Executor task launch worker-2] INFO o.apache.spark.storage.BlockManager - Found block rdd_215_0 locally
16:58:07.380 [Executor task launch worker-2] INFO org.apache.spark.executor.Executor - Finished task 1.0 in stage 113.0 (TID 112). 1733 bytes result sent to driver
16:58:07.380 [Result resolver thread-0] INFO o.a.spark.scheduler.TaskSetManager - Finished task 1.0 in stage 113.0 (TID 112) in 9 ms on localhost (3/3)
16:58:07.380 [Result resolver thread-0] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 113.0, whose tasks have all completed, from pool
16:58:07.380 [sparkDriver-akka.actor.default-dispatcher-19] INFO o.a.spark.scheduler.DAGScheduler - Stage 113 (aggregate at AreaUnderCurve.scala:45) finished in 0.009 s
16:58:07.380 [main] INFO org.apache.spark.SparkContext - Job finished: aggregate at AreaUnderCurve.scala:45, took 0.013970632 s
Area under ROC = 0.6766691672918231
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 84.882 sec
Running org.graphify.core.api.extraction.FeaturesTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.008 sec <<< FAILURE!
Running org.graphify.core.api.selection.FeatureSelectorTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.034 sec <<< FAILURE!
Running org.graphify.core.kernel.impl.manager.NodeManagerTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.065 sec
Running org.graphify.core.kernel.impl.util.GraphManagerTest
{0} is known {1}
Tests run: 6, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 0 sec
Running org.graphify.core.kernel.impl.util.VectorUtilTest
16:58:07.672 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.apache.spark.storage.BlockManager - Removing broadcast 210
16:58:07.672 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_210
16:58:07.672 [sparkDriver-akka.actor.default-dispatcher-20] INFO org.apache.spark.storage.MemoryStore - Block broadcast_210 of size 5216 dropped from memory (free 992520356)
16:58:07.672 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 210
16:58:07.673 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing broadcast 209
16:58:07.673 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_209
16:58:07.673 [sparkDriver-akka.actor.default-dispatcher-5] INFO org.apache.spark.storage.MemoryStore - Block broadcast_209 of size 4968 dropped from memory (free 992525324)
16:58:07.673 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 209
16:58:07.676 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing RDD 215
16:58:07.679 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block rdd_215_0
16:58:07.680 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block rdd_215_0 of size 6232 dropped from memory (free 992531556)
16:58:07.681 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned RDD 215
16:58:07.681 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 208
16:58:07.681 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_208
16:58:07.681 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_208 of size 3152 dropped from memory (free 992534708)
16:58:07.681 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 208
16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing broadcast 207
16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_207
16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-5] INFO org.apache.spark.storage.MemoryStore - Block broadcast_207 of size 2752 dropped from memory (free 992537460)
16:58:07.683 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 207
16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-15] INFO o.apache.spark.storage.BlockManager - Removing broadcast 206
16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-15] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_206
16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-15] INFO org.apache.spark.storage.MemoryStore - Block broadcast_206 of size 43128 dropped from memory (free 992580588)
16:58:07.683 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 206
16:58:07.684 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing broadcast 205
16:58:07.684 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_205
16:58:07.684 [sparkDriver-akka.actor.default-dispatcher-5] INFO org.apache.spark.storage.MemoryStore - Block broadcast_205 of size 4080 dropped from memory (free 992584668)
16:58:07.684 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 205
16:58:07.694 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned shuffle 3
16:58:07.695 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.a.s.storage.ShuffleBlockManager - Deleted all files for shuffle 2
16:58:07.695 [sparkDriver-akka.actor.default-dispatcher-15] INFO o.a.s.storage.ShuffleBlockManager - Deleted all files for shuffle 3
16:58:07.695 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned shuffle 2
16:58:07.695 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.a.s.storage.ShuffleBlockManager - Deleted all files for shuffle 1
16:58:07.695 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned shuffle 1
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-15] INFO o.a.s.storage.ShuffleBlockManager - Deleted all files for shuffle 0
16:58:07.696 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned shuffle 0
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 161
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_161
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_161 of size 45056 dropped from memory (free 992629724)
16:58:07.696 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 161
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 160
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_160
16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_160 of size 38960 dropped from memory (free 992668684)
16:58:07.696 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 160
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 61
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_61
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_61 of size 45056 dropped from memory (free 992713740)
16:58:07.697 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 61
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 60
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_60
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_60 of size 38960 dropped from memory (free 992752700)
16:58:07.697 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 60
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.apache.spark.storage.BlockManager - Removing broadcast 1
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_1
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_1 of size 4184 dropped from memory (free 992756884)
16:58:07.697 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 1
16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing RDD 3
16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block rdd_3_0
16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block rdd_3_0 of size 4909480 dropped from memory (free 997666364)
16:58:07.698 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned RDD 3
16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 0
16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_0
16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_0 of size 32728 dropped from memory (free 997699092)
16:58:07.698 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 0
[labels=[positive, negative], type=binary]
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.42 sec <<< FAILURE!
Results :
Tests in error:
testExtractFeatures(org.graphify.core.api.extraction.FeaturesTest): Node 0 not found
testCreateFeatureTarget(org.graphify.core.api.selection.FeatureSelectorTest): Node 0 not found
binaryClassificationTest(org.graphify.core.kernel.impl.util.VectorUtilTest)
Tests run: 13, Failures: 0, Errors: 3, Skipped: 3
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:26.963s
[INFO] Finished at: Tue Jun 16 16:58:08 EDT 2015
[INFO] Final Memory: 13M/215M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.10:test (default-test) on project graphify: There are test failures.
[ERROR]
[ERROR] Please refer to /home/ciceromar/Downloads/graphify-1.0.0-M01/graphify-1.0.0-M01/src/extension/target/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.10:test (default-test) on project graphify: There are test failures.
Please refer to /home/ciceromar/Downloads/graphify-1.0.0-M01/graphify-1.0.0-M01/src/extension/target/surefire-reports for the individual test results.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:213)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.MojoExecutor.executeForkedExecutions(MojoExecutor.java:365)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:199)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoFailureException: There are test failures.
Please refer to /home/ciceromar/Downloads/graphify-1.0.0-M01/graphify-1.0.0-M01/src/extension/target/surefire-reports for the individual test results.
at org.apache.maven.plugin.surefire.SurefireHelper.reportExecution(SurefireHelper.java:87)
at org.apache.maven.plugin.surefire.SurefirePlugin.writeSummary(SurefirePlugin.java:641)
at org.apache.maven.plugin.surefire.SurefirePlugin.handleSummary(SurefirePlugin.java:615)
at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:137)
at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:98)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
... 23 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
Hi Kenny,
I posted as a comment to this issue on a previously closed issue. Basically, still having a build issue for the 1.0.0-M01 branch. Is there a solution to this? My output is below.
mvn assembly:assembly -DdescriptorId=jar-with-dependencies --debug
cutor - Finished task 0.0 in stage 106.0 (TID 105). 1000 bytes result sent to driver 16:58:07.296 [Result resolver thread-1] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 106.0 (TID 105) in 87 ms on localhost (1/1) 16:58:07.296 [Result resolver thread-1] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 106.0, whose tasks have all completed, from pool 16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Stage 106 (map at ClassifierUtil.java:42) finished in 0.088 s 16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - looking for newly runnable stages 16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - running: Set() 16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - waiting: Set(Stage 103, Stage 107) 16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - failed: Set() 16:58:07.297 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents for Stage 103: List(Stage 107) 16:58:07.298 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents for Stage 107: List() 16:58:07.298 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting Stage 107 (ShuffledRDD[211] at combineByKey at BinaryClassificationMetrics.scala:101), which is now runnable 16:58:07.298 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(2752) called with curMem=5161632, maxMem=997699092 16:58:07.298 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_207 stored as values in memory (estimated size 2.7 KB, free 946.6 MB) 16:58:07.299 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting 1 missing tasks from Stage 107 (ShuffledRDD[211] at combineByKey at BinaryClassificationMetrics.scala:101) 16:58:07.299 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.s.scheduler.TaskSchedulerImpl - Adding task set 107.0 with 1 tasks 16:58:07.299 [sparkDriver-akka.actor.default-dispatcher-2] INFO o.a.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 107.0 (TID 106, localhost, PROCESS_LOCAL, 937 bytes) 16:58:07.299 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 107.0 (TID 106) 16:58:07.300 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - maxBytesInFlight: 50331648, targetRequestSize: 10066329 16:58:07.300 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Getting 1 non-empty blocks out of 1 blocks 16:58:07.300 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Started 0 remote fetches in 0 ms 16:58:07.305 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 107.0 (TID 106). 1000 bytes result sent to driver 16:58:07.305 [Result resolver thread-2] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 107.0 (TID 106) in 6 ms on localhost (1/1) 16:58:07.305 [Result resolver thread-2] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 107.0, whose tasks have all completed, from pool 16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Stage 107 (combineByKey at BinaryClassificationMetrics.scala:101) finished in 0.006 s 16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - looking for newly runnable stages 16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - running: Set() 16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - waiting: Set(Stage 103) 16:58:07.305 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - failed: Set() 16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents for Stage 103: List() 16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting Stage 103 (MapPartitionsRDD[214] at mapPartitions at BinaryClassificationMetrics.scala:106), which is now runnable 16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(3152) called with curMem=5164384, maxMem=997699092 16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_208 stored as values in memory (estimated size 3.1 KB, free 946.6 MB) 16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting 1 missing tasks from Stage 103 (MapPartitionsRDD[214] at mapPartitions at BinaryClassificationMetrics.scala:106) 16:58:07.306 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.s.scheduler.TaskSchedulerImpl - Adding task set 103.0 with 1 tasks 16:58:07.307 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.a.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 103.0 (TID 107, localhost, PROCESS_LOCAL, 948 bytes) 16:58:07.307 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 103.0 (TID 107) 16:58:07.307 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - maxBytesInFlight: 50331648, targetRequestSize: 10066329 16:58:07.307 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Getting 1 non-empty blocks out of 1 blocks 16:58:07.307 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Started 0 remote fetches in 0 ms 16:58:07.320 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 103.0 (TID 107). 991 bytes result sent to driver 16:58:07.321 [Result resolver thread-3] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 103.0 (TID 107) in 15 ms on localhost (1/1) 16:58:07.321 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Stage 103 (collect at BinaryClassificationMetrics.scala:110) finished in 0.015 s 16:58:07.321 [Result resolver thread-3] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 103.0, whose tasks have all completed, from pool 16:58:07.321 [main] INFO org.apache.spark.SparkContext - Job finished: collect at BinaryClassificationMetrics.scala:110, took 0.284472139 s 16:58:07.323 [main] INFO o.a.s.m.e.BinaryClassificationMetrics - Total counts: {numPos: 31, numNeg: 43} 16:58:07.339 [main] INFO org.apache.spark.SparkContext - Starting job: runJob at SlidingRDD.scala:74 16:58:07.341 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.MapOutputTrackerMaster - Size of output statuses for shuffle 1 is 137 bytes 16:58:07.343 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.MapOutputTrackerMaster - Size of output statuses for shuffle 0 is 137 bytes 16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.MapOutputTrackerMaster - Size of output statuses for shuffle 3 is 137 bytes 16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.MapOutputTrackerMaster - Size of output statuses for shuffle 2 is 137 bytes 16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Got job 104 (runJob at SlidingRDD.scala:74) with 2 output partitions (allowLocal=true) 16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Final stage: Stage 108(runJob at SlidingRDD.scala:74) 16:58:07.344 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Parents of final stage: List(Stage 112) 16:58:07.345 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents: List() 16:58:07.345 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting Stage 108 (UnionRDD[220] at UnionRDD at BinaryClassificationMetrics.scala:54), which has no missing parents 16:58:07.351 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(4968) called with curMem=5167536, maxMem=997699092 16:58:07.351 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_209 stored as values in memory (estimated size 4.9 KB, free 946.5 MB) 16:58:07.352 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting 2 missing tasks from Stage 108 (UnionRDD[220] at UnionRDD at BinaryClassificationMetrics.scala:54) 16:58:07.352 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.s.scheduler.TaskSchedulerImpl - Adding task set 108.0 with 2 tasks 16:58:07.352 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.a.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 108.0 (TID 108, localhost, PROCESS_LOCAL, 1057 bytes) 16:58:07.354 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.a.spark.scheduler.TaskSetManager - Starting task 1.0 in stage 108.0 (TID 109, localhost, PROCESS_LOCAL, 1401 bytes) 16:58:07.354 [Executor task launch worker-0] INFO org.apache.spark.executor.Executor - Running task 1.0 in stage 108.0 (TID 109) 16:58:07.355 [Executor task launch worker-0] INFO org.apache.spark.executor.Executor - Finished task 1.0 in stage 108.0 (TID 109). 723 bytes result sent to driver 16:58:07.356 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 108.0 (TID 108) 16:58:07.356 [Result resolver thread-0] INFO o.a.spark.scheduler.TaskSetManager - Finished task 1.0 in stage 108.0 (TID 109) in 4 ms on localhost (1/2) 16:58:07.356 [Executor task launch worker-1] INFO org.apache.spark.CacheManager - Partition rdd_215_0 not found, computing it 16:58:07.357 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - maxBytesInFlight: 50331648, targetRequestSize: 10066329 16:58:07.357 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Getting 1 non-empty blocks out of 1 blocks 16:58:07.357 [Executor task launch worker-1] INFO o.a.s.s.BlockFetcherIterator$BasicBlockFetcherIterator - Started 0 remote fetches in 0 ms 16:58:07.361 [Executor task launch worker-1] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(6232) called with curMem=5172504, maxMem=997699092 16:58:07.362 [Executor task launch worker-1] INFO org.apache.spark.storage.MemoryStore - Block rdd_215_0 stored as values in memory (estimated size 6.1 KB, free 946.5 MB) 16:58:07.363 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.storage.BlockManagerInfo - Added rdd_215_0 in memory on 172.29.85.226:33829 (size: 6.1 KB, free: 946.8 MB) 16:58:07.363 [Executor task launch worker-1] INFO o.a.spark.storage.BlockManagerMaster - Updated info of block rdd_215_0 16:58:07.364 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 108.0 (TID 108). 1533 bytes result sent to driver 16:58:07.364 [Result resolver thread-1] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 108.0 (TID 108) in 12 ms on localhost (2/2) 16:58:07.364 [Result resolver thread-1] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 108.0, whose tasks have all completed, from pool 16:58:07.365 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Stage 108 (runJob at SlidingRDD.scala:74) finished in 0.011 s 16:58:07.365 [main] INFO org.apache.spark.SparkContext - Job finished: runJob at SlidingRDD.scala:74, took 0.025972716 s 16:58:07.366 [main] INFO org.apache.spark.SparkContext - Starting job: aggregate at AreaUnderCurve.scala:45 16:58:07.367 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Got job 105 (aggregate at AreaUnderCurve.scala:45) with 3 output partitions (allowLocal=false) 16:58:07.367 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Final stage: Stage 113(aggregate at AreaUnderCurve.scala:45) 16:58:07.367 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Parents of final stage: List(Stage 117) 16:58:07.368 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Missing parents: List() 16:58:07.369 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting Stage 113 (SlidingRDD[221] at RDD at SlidingRDD.scala:47), which has no missing parents 16:58:07.369 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - ensureFreeSpace(5216) called with curMem=5178736, maxMem=997699092 16:58:07.369 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_210 stored as values in memory (estimated size 5.1 KB, free 946.5 MB) 16:58:07.370 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.spark.scheduler.DAGScheduler - Submitting 3 missing tasks from Stage 113 (SlidingRDD[221] at RDD at SlidingRDD.scala:47) 16:58:07.371 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.a.s.scheduler.TaskSchedulerImpl - Adding task set 113.0 with 3 tasks 16:58:07.371 [sparkDriver-akka.actor.default-dispatcher-19] INFO o.a.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 113.0 (TID 110, localhost, PROCESS_LOCAL, 1805 bytes) 16:58:07.371 [sparkDriver-akka.actor.default-dispatcher-19] INFO o.a.spark.scheduler.TaskSetManager - Starting task 2.0 in stage 113.0 (TID 111, localhost, PROCESS_LOCAL, 1558 bytes) 16:58:07.371 [sparkDriver-akka.actor.default-dispatcher-19] INFO o.a.spark.scheduler.TaskSetManager - Starting task 1.0 in stage 113.0 (TID 112, localhost, ANY, 1599 bytes) 16:58:07.371 [Executor task launch worker-0] INFO org.apache.spark.executor.Executor - Running task 2.0 in stage 113.0 (TID 111) 16:58:07.371 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 113.0 (TID 110) 16:58:07.374 [Executor task launch worker-1] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 113.0 (TID 110). 625 bytes result sent to driver 16:58:07.376 [Executor task launch worker-0] INFO org.apache.spark.executor.Executor - Finished task 2.0 in stage 113.0 (TID 111). 625 bytes result sent to driver 16:58:07.377 [Executor task launch worker-2] INFO org.apache.spark.executor.Executor - Running task 1.0 in stage 113.0 (TID 112) 16:58:07.378 [Result resolver thread-2] INFO o.a.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 113.0 (TID 110) in 7 ms on localhost (1/3) 16:58:07.379 [Result resolver thread-2] INFO o.a.spark.scheduler.TaskSetManager - Finished task 2.0 in stage 113.0 (TID 111) in 8 ms on localhost (2/3) 16:58:07.379 [Executor task launch worker-2] INFO o.apache.spark.storage.BlockManager - Found block rdd_215_0 locally 16:58:07.380 [Executor task launch worker-2] INFO org.apache.spark.executor.Executor - Finished task 1.0 in stage 113.0 (TID 112). 1733 bytes result sent to driver 16:58:07.380 [Result resolver thread-0] INFO o.a.spark.scheduler.TaskSetManager - Finished task 1.0 in stage 113.0 (TID 112) in 9 ms on localhost (3/3) 16:58:07.380 [Result resolver thread-0] INFO o.a.s.scheduler.TaskSchedulerImpl - Removed TaskSet 113.0, whose tasks have all completed, from pool 16:58:07.380 [sparkDriver-akka.actor.default-dispatcher-19] INFO o.a.spark.scheduler.DAGScheduler - Stage 113 (aggregate at AreaUnderCurve.scala:45) finished in 0.009 s 16:58:07.380 [main] INFO org.apache.spark.SparkContext - Job finished: aggregate at AreaUnderCurve.scala:45, took 0.013970632 s Area under ROC = 0.6766691672918231 Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 84.882 sec Running org.graphify.core.api.extraction.FeaturesTest Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.008 sec <<< FAILURE! Running org.graphify.core.api.selection.FeatureSelectorTest Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.034 sec <<< FAILURE! Running org.graphify.core.kernel.impl.manager.NodeManagerTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.065 sec Running org.graphify.core.kernel.impl.util.GraphManagerTest {0} is known {1} Tests run: 6, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 0 sec Running org.graphify.core.kernel.impl.util.VectorUtilTest 16:58:07.672 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.apache.spark.storage.BlockManager - Removing broadcast 210 16:58:07.672 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_210 16:58:07.672 [sparkDriver-akka.actor.default-dispatcher-20] INFO org.apache.spark.storage.MemoryStore - Block broadcast_210 of size 5216 dropped from memory (free 992520356) 16:58:07.672 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 210 16:58:07.673 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing broadcast 209 16:58:07.673 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_209 16:58:07.673 [sparkDriver-akka.actor.default-dispatcher-5] INFO org.apache.spark.storage.MemoryStore - Block broadcast_209 of size 4968 dropped from memory (free 992525324) 16:58:07.673 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 209 16:58:07.676 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing RDD 215 16:58:07.679 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block rdd_215_0 16:58:07.680 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block rdd_215_0 of size 6232 dropped from memory (free 992531556) 16:58:07.681 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned RDD 215 16:58:07.681 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 208 16:58:07.681 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_208 16:58:07.681 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_208 of size 3152 dropped from memory (free 992534708) 16:58:07.681 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 208 16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing broadcast 207 16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_207 16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-5] INFO org.apache.spark.storage.MemoryStore - Block broadcast_207 of size 2752 dropped from memory (free 992537460) 16:58:07.683 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 207 16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-15] INFO o.apache.spark.storage.BlockManager - Removing broadcast 206 16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-15] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_206 16:58:07.683 [sparkDriver-akka.actor.default-dispatcher-15] INFO org.apache.spark.storage.MemoryStore - Block broadcast_206 of size 43128 dropped from memory (free 992580588) 16:58:07.683 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 206 16:58:07.684 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing broadcast 205 16:58:07.684 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_205 16:58:07.684 [sparkDriver-akka.actor.default-dispatcher-5] INFO org.apache.spark.storage.MemoryStore - Block broadcast_205 of size 4080 dropped from memory (free 992584668) 16:58:07.684 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 205 16:58:07.694 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned shuffle 3 16:58:07.695 [sparkDriver-akka.actor.default-dispatcher-20] INFO o.a.s.storage.ShuffleBlockManager - Deleted all files for shuffle 2 16:58:07.695 [sparkDriver-akka.actor.default-dispatcher-15] INFO o.a.s.storage.ShuffleBlockManager - Deleted all files for shuffle 3 16:58:07.695 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned shuffle 2 16:58:07.695 [sparkDriver-akka.actor.default-dispatcher-5] INFO o.a.s.storage.ShuffleBlockManager - Deleted all files for shuffle 1 16:58:07.695 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned shuffle 1 16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-15] INFO o.a.s.storage.ShuffleBlockManager - Deleted all files for shuffle 0 16:58:07.696 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned shuffle 0 16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 161 16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_161 16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_161 of size 45056 dropped from memory (free 992629724) 16:58:07.696 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 161 16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 160 16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_160 16:58:07.696 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_160 of size 38960 dropped from memory (free 992668684) 16:58:07.696 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 160 16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 61 16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_61 16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_61 of size 45056 dropped from memory (free 992713740) 16:58:07.697 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 61 16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 60 16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_60 16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_60 of size 38960 dropped from memory (free 992752700) 16:58:07.697 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 60 16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.apache.spark.storage.BlockManager - Removing broadcast 1 16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-17] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_1 16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-17] INFO org.apache.spark.storage.MemoryStore - Block broadcast_1 of size 4184 dropped from memory (free 992756884) 16:58:07.697 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 1 16:58:07.697 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing RDD 3 16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block rdd_3_0 16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block rdd_3_0 of size 4909480 dropped from memory (free 997666364) 16:58:07.698 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned RDD 3 16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing broadcast 0 16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO o.apache.spark.storage.BlockManager - Removing block broadcast_0 16:58:07.698 [sparkDriver-akka.actor.default-dispatcher-14] INFO org.apache.spark.storage.MemoryStore - Block broadcast_0 of size 32728 dropped from memory (free 997699092) 16:58:07.698 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned broadcast 0 [labels=[positive, negative], type=binary] Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.42 sec <<< FAILURE!
Results :
Tests in error: testExtractFeatures(org.graphify.core.api.extraction.FeaturesTest): Node 0 not found testCreateFeatureTarget(org.graphify.core.api.selection.FeatureSelectorTest): Node 0 not found binaryClassificationTest(org.graphify.core.kernel.impl.util.VectorUtilTest)
Tests run: 13, Failures: 0, Errors: 3, Skipped: 3
[INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 1:26.963s [INFO] Finished at: Tue Jun 16 16:58:08 EDT 2015 [INFO] Final Memory: 13M/215M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.10:test (default-test) on project graphify: There are test failures. [ERROR] [ERROR] Please refer to /home/ciceromar/Downloads/graphify-1.0.0-M01/graphify-1.0.0-M01/src/extension/target/surefire-reports for the individual test results. [ERROR] -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.10:test (default-test) on project graphify: There are test failures.
Please refer to /home/ciceromar/Downloads/graphify-1.0.0-M01/graphify-1.0.0-M01/src/extension/target/surefire-reports for the individual test results. at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:213) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.MojoExecutor.executeForkedExecutions(MojoExecutor.java:365) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:199) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196) at org.apache.maven.cli.MavenCli.main(MavenCli.java:141) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) Caused by: org.apache.maven.plugin.MojoFailureException: There are test failures.
Please refer to /home/ciceromar/Downloads/graphify-1.0.0-M01/graphify-1.0.0-M01/src/extension/target/surefire-reports for the individual test results. at org.apache.maven.plugin.surefire.SurefireHelper.reportExecution(SurefireHelper.java:87) at org.apache.maven.plugin.surefire.SurefirePlugin.writeSummary(SurefirePlugin.java:641) at org.apache.maven.plugin.surefire.SurefirePlugin.handleSummary(SurefirePlugin.java:615) at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:137) at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:98) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209) ... 23 more [ERROR] [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException