search

TresAmigosSD / SMV

Spark Modularized View
Apache License 2.0
42 stars 22 forks source link

Graph Util test failure when building fresh #339

Closed laneb closed 6 years ago

laneb commented 8 years ago

I just cloned the repository and ran sbt assembly. sbt reports org.tresamigos.smv.SmvGraphUtilTest failed. This is the full build log:

[info] Loading project definition from /home/lbarlow/SMV/project
[info] Updating {file:/home/lbarlow/SMV/project/}smv-build...
[info] Resolving org.scala-sbt.ivy#ivy;2.3.0-sbt-2cc8d2761242b072cedb0a04cb[info] Resolving org.fusesource.jansi#jansi;1.4 ...
[info] Done updating.
[info] Set current project to smv (in build file:/home/lbarlow/SMV/)
[info] Updating {file:/home/lbarlow/SMV/}smv...
[info] Resolving com.sun.jersey.jersey-test-framework#jersey-test-framework[info] Resolving com.fasterxml.jackson.module#jackson-module-scala_2.10;2.4[info] Resolving org.fusesource.jansi#jansi;1.4 ...
[info] Done updating.
[info] Compiling 64 Scala sources and 1 Java source to /home/lbarlow/SMV/tascala-2.10/classes...
[warn] /home/lbarlow/SMV/src/main/scala/org/tresamigos/smv/ColumnHelper.sca2: @deprecated now takes two arguments; see the scaladoc.
[warn]   @deprecated("should use smvDesc instead")
[warn]    ^
[warn] /home/lbarlow/SMV/src/main/scala/org/tresamigos/smv/cds/SmvGDO.scala class SmvChunkUDF in package cds is deprecated: will remove after 1.3
[warn] private[smv] class SmvChunkUDFGDO(cudf: SmvChunkUDF, isPlus: Booleanends SmvGDO {
[warn]                                         ^
[warn] there were 1 unchecked warning(s); re-run with -unchecked for detail
[warn] three warnings found
[warn] Multiple main classes detected.  Run 'show discoveredMainClasses' tothe list
[info] Compiling 48 Scala sources to /home/lbarlow/SMV/target/scala-2.10/teasses...
[info] Including: jetty-client-8.1.18.v20150929.jar
[info] Including: jetty-continuation-8.1.18.v20150929.jar
[info] Including: httpclient-4.3.2.jar
[info] Including: jetty-http-8.1.18.v20150929.jar
[info] Including: guava-14.0.1.jar
[info] Including: jetty-io-8.1.18.v20150929.jar
[info] Including: httpcore-4.3.1.jar
[info] Including: jetty-util-8.1.18.v20150929.jar
[info] Including: commons-logging-1.1.3.jar
[info] Including: jetty-server-8.1.18.v20150929.jar
[info] Including: commons-codec-1.6.jar
[info] Including: joda-convert-1.7.jar
[info] Including: javax.servlet-3.0.0.v201112011016.jar
[info] Including: joda-time-2.7.jar
[info] Including: scallop_2.10-0.9.5.jar
[info] Including: stringmetric-core_2.10-0.27.2.jar
[info] Including: ascii-graphs_2.10-0.0.6.jar
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/class_loader/CladerTest.scala:42: inferred existential type Class[?0] forSome { type ?0 >: ype ?0 }, which cannot be expressed by wildcards,  should be enabled
[warn] by making the implicit value scala.language.existentials visible.
[warn] This can be achieved by adding the import clause 'import scala.languxistentials'
[warn] or by setting the compiler option -language:existentials.
[warn] See the Scala docs for value scala.language.existentials for a discu
[warn] why the feature should be explicitly enabled.
[warn]     val bar = foo.getSuperclass
[warn]                   ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/AggFuncsTest.sca: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom ins
[warn]     val df = createSchemaRdd("k:String; t:Integer; v:Double", "z,1,;.4;z,5,2.2;a,1,0.3;")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/AggFuncsTest.sca: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom ins
[warn]     val df = createSchemaRdd("k:String; v1:Integer; v2:Double", "X,,)
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/AggFuncsTest.sca: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom ins
[warn]     val df = createSchemaRdd("v1:Boolean; v2:Boolean; v3: Boolean", ,,;false,false,;,false,")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:22: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFromead
[warn]     val df = createSchemaRdd("k:String; v:String;", "1,a;2,")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:35: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFromead
[warn]     val df = createSchemaRdd("k:String; v:String;", "1,a;2,")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:36: method smvLength in class ColumnHelper is deprecated: should use Sparlen() function
[warn]     val res = df.select($"v".smvLength)
[warn]                              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:44: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFromead
[warn]     val df = createSchemaRdd("k:String; v:String;", "20190101,a;,b")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:53: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFromead
[warn]     val df = createSchemaRdd("k:Timestamp[yyyyMMdd]; v:String;", "201,a;,b")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:61: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFromead
[warn]     val df = createSchemaRdd("k:Timestamp[yyyyMMdd]; v:Double;", "201,1213.3;,31312.9")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:69: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFromead
[warn]     val df = createSchemaRdd("a:String", "Smith;Liu;Brown;  Funny ;O0Obama")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:70: method smvSoundex in class ColumnHelper is deprecated: should use Spaundex() function
[warn]     val res = df.select($"a".smvSoundex)
[warn]                              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:76: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFromead
[warn]     val df = createSchemaRdd("a:String", "Smith;Liu;Brown;  Funny ;O0Obama")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:84: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFromead
[warn]     val df = createSchemaRdd("t:Timestamp[yyyyMMdd]", "19760131;2012)
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:111: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrotead
[warn]     val df = createSchemaRdd("t:Timestamp[yyyyMMdd]", "19760131;2012)
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:127: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrotead
[warn]     val df = createSchemaRdd("k:String; t:Integer; v:Double", "z,1,02,1.4;z,5,2.2;a,1,0.3;")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:128: method withDesc in class ColumnHelper is deprecated: should use smvDnstead
[warn]     val res = df.selectWithReplace($"t" withDesc "the time sequence"
[warn]                                         ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:155: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrotead
[warn]     val df = createSchemaRdd("k:Integer; v:Double;", "1,0.0;1,100.0;0;1,65.0")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:166: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrotead
[warn]     val df = createSchemaRdd("k:Integer; v:Double;", "1,0.0;1,100.0;0;1,65.0;1,83.0")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:176: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrotead
[warn]     val df = createSchemaRdd("k:String; v:String;", "a,b;c,d;,").selrray($"k", $"v") as "arr")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:185: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrotead
[warn]     val df = createSchemaRdd("k:String; v:String;", "a,b;c,d;,").selrray($"k", $"v") as "arr")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:194: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrotead
[warn]     val df = createSchemaRdd("k:String; v:String;", "a,b;c,d;,").selrray($"k", $"v") as "arr")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:204: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrotead
[warn]     val df = createSchemaRdd("st:String", "Q201301;M201512;D20141201
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:219: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrotead
[warn]     val df = createSchemaRdd("k:String; t:Integer; v:Double", "z,1,02,1.4;z,5,2.2;a,1,0.3;")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:220: method smvPrintToStr in class ColumnHelper is deprecated: should usek printf() function
[warn]     val res = df.select($"t".smvPrintToStr("%03d") as "tstr", $"v".sntToStr("%.3e") as "vstr")
[warn]                              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:220: method smvPrintToStr in class ColumnHelper is deprecated: should usek printf() function
[warn]     val res = df.select($"t".smvPrintToStr("%03d") as "tstr", $"v".sntToStr("%.3e") as "vstr")
[warn]                                                                    ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:234: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrotead
[warn]     val df = createSchemaRdd("k:String", "z ; 1; 3 ;")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:235: method smvStrTrim in class ColumnHelper is deprecated: should use Sprim() function
[warn]     val res = df.select($"k".smvStrTrim)
[warn]                              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/ColumnHelperTesta:250: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrotead
[warn]     val df = createSchemaRdd("a:Double;b:Integer", "0.4,5;0,0;,")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/CsvTest.scala:18hod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instead
[warn]     val df = createSchemaRdd("a:Integer;b:Double", "1 , 0.2 ; 2, 1 ;, ;5, 3.")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/CsvTest.scala:51hod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instead
[warn]     val df = createSchemaRdd("f1:String;f2:String", "x,y;a,b").reparn(1)
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/CsvTest.scala:10thod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instead
[warn]     var df = createSchemaRdd("f1:String;f2:String", "\"left\"\"righta,\",\"escape char \\\";\"a\",\"b\"").repartition(1)
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/CsvTest.scala:12thod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instead
[warn]     df = createSchemaRdd("@delimiter = ,;@has-header = false;@quote-= ^;f1:String;f2:String", "^left\\^right quote\\\" comma\\, ^,^escape char\a,b").repartition(1)
[warn]          ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/CsvTest.scala:13thod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instead
[warn]     df = createSchemaRdd("a:String;b:Array[String]",""" "a1", "b""1|"").repartition(1)
[warn]          ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/DQMTest.scala:53hod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instead
[warn]     val df = createSchemaRdd("a:Integer;b:Double", "1,0.3;0,0.2")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/DQMTest.scala:69hod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instead
[warn]     val df = createSchemaRdd("a:Integer;b:Double", "1,0.3;0,0.2")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/DQMTest.scala:80hod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instead
[warn]     val df = createSchemaRdd("a:Integer;b:Double", "1,0.3;0,0.2")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/DQMTest.scala:10thod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instead
[warn]     val df = createSchemaRdd("a:Integer;b:Double", "1,0.3;0,0.2;3,0.
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/DQMTest.scala:12thod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instead
[warn]     val df = createSchemaRdd("a:Integer;b:Double", "1,0.3;0,0.2;3,0.
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/DoubleBinHistogrt.scala:22: method createSchemaRdd in trait SmvTestUtil is deprecated: Use m instead
[warn]     val df = createSchemaRdd("id:Integer; v:Double;",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/DoubleBinHistogrt.scala:37: method createSchemaRdd in trait SmvTestUtil is deprecated: Use m instead
[warn]     val df = createSchemaRdd("id1:Integer; id2:Integer; v1:Double; vble;",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/DoubleBinHistogrt.scala:59: method createSchemaRdd in trait SmvTestUtil is deprecated: Use m instead
[warn]     val df = createSchemaRdd("id1:Integer; id2:Integer; v1:Double; vble;",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/DoubleBinHistogrt.scala:81: method createSchemaRdd in trait SmvTestUtil is deprecated: Use m instead
[warn]     val df = createSchemaRdd("id:Integer; v:Double;",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/EddTest.scala:23hod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instead
[warn]     val df1 = createSchemaRdd("a:String;b:String;c:String;d:String;fng",
[warn]               ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/EddTest.scala:28hod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instead
[warn]     val df2 = createSchemaRdd("a:String;b:String;c:String;d:String",
[warn]               ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/EddTest.scala:42hod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instead
[warn]     val df1 = createSchemaRdd("a:String;b:String;c:String;d:String;fng",
[warn]               ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/EddTest.scala:91hod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instead
[warn]     df = createSchemaRdd("k:String; t:Integer; p: String; v:Double; estamp[yyyyMMdd]; b:Boolean",
[warn]          ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/EddTest.scala:33thod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instead
[warn]     val df2 = createSchemaRdd("v:decimal[8, 3]", "12.455;123.134;122)
[warn]               ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/EddTest.scala:34thod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instead
[warn]     val df2 = createSchemaRdd("k:String; t:Integer; p: String; v:Doud:Timestamp[yyyyMMdd]; b:Boolean",
[warn]               ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/EddTest.scala:35thod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instead
[warn]     val df2 = createSchemaRdd("k:String; t:Integer; p: String; v:Doud:Timestamp[yyyyMMdd]; b:Boolean",
[warn]               ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/PivotTest.scala:ethod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instea
[warn]     val df = createSchemaRdd("k:String; p1:String; p2:String; p3:Strv:String; v2:Float",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/PivotTest.scala:ethod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instea
[warn]     val df = createSchemaRdd("p1:String; p2:String; p3:String; v:Str
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/PivotTest.scala:ethod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instea
[warn]     val df = createSchemaRdd("p1:String; v:String","p1_1,5; p1_2, 6"
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/PivotTest.scala:ethod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instea
[warn]     val df = createSchemaRdd("id:Integer;month:String;product:Stringt:Integer",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/PivotTest.scala:ethod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instea
[warn]     val df = createSchemaRdd("id:Integer;month:String;product:Stringt:Integer",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/PivotTest.scala:ethod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instea
[warn]     val df = createSchemaRdd("k1:String; k2:String; p:String; v1:Int v2:Float",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/PivotTest.scala:method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inste
[warn]     val df = createSchemaRdd("k:String; p1:String; p2:String; v:Inte
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/PivotTest.scala:method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inste
[warn]     val df = createSchemaRdd("k:String; p:String; v1:Integer; v2:Flo
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/PivotTest.scala:method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inste
[warn]     val df = createSchemaRdd("k:String; p:String; v:String",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/PivotTest.scala:method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inste
[warn]     val df = createSchemaRdd("k:String; p:String; v:String",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/PivotTest.scala:method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inste
[warn]     val df = createSchemaRdd("k:String; v:String",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/PivotTest.scala:method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inste
[warn]     val df = createSchemaRdd("k:String; v:String",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/PivotTest.scala:method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inste
[warn]     val df = createSchemaRdd("k:String; p:String; v:String",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/RankTest.scala:2thod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom instead
[warn]     val df = createSchemaRdd("k:Integer; v:String;",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/RejectTest.scalamethod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inste
[warn]       val prdd = createSchemaRdd("a:String;b:Double;c:String;d:StrinataStr)
[warn]                  ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/RollupCubeOpTesta:33: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFromead
[warn]     val df = createSchemaRdd("a:String; b:String; c:String; d:String,b,c,d")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/RollupCubeOpTesta:38: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFromead
[warn]     val df = createSchemaRdd("a:String; b:String; c:String; d:Intege
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/RollupCubeOpTesta:52: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFromead
[warn]     val df = createSchemaRdd("a:String; b:String; c:String; d:Integea,b,c,1")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/RollupCubeOpTesta:61: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFromead
[warn]     val df = createSchemaRdd("a:String; b:String; f:String; d:Intege
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/RollupCubeOpTesta:103: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrotead
[warn]     val df = createSchemaRdd("a:String; b:String; c:String; d:Intege
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc5: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom in
[warn]     createSchemaRdd(schema, data.mkString(";"))
[warn]     ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc4: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom in
[warn]     val df = createSchemaRdd("a:Double;b:Double", "1.0,10.0;2.0,20.030.0")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc4: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom in
[warn]     val df = createSchemaRdd("a:Double;b:Double", "1.0,10.0;2.0,20.030.0")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc4: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom in
[warn]     val df = createSchemaRdd("a:Double;b:Double", "1.0,10.0;2.0,20.030.0")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc4: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom in
[warn]     val df = createSchemaRdd("id:String;a:Double;b:Double", "a,1.0,1,2.0,20.0;b,3.0,30.0")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc3: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom in
[warn]     val df = createSchemaRdd("a:Integer; b:Double; c:String",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc04: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val df = createSchemaRdd("a:Integer; b:Double; c:String",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc14: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val df = createSchemaRdd("a:Integer; b:Double; c:String",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc25: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val df = createSchemaRdd("a:Integer; b:Double; c:String",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc36: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val df = createSchemaRdd("a:Integer; b:String", "1,abc;1,def;2,g
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc38: method withDesc in class ColumnHelper is deprecated: should use smvDescead
[warn]     val res1 = df.groupBy(df("a")).agg(functions.count(df("a")) withdesc as "c")
[warn]                                                                 ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc46: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val df = createSchemaRdd("a:Integer; b:String", "1,abc;1,def;2,g
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc48: method withDesc in class ColumnHelper is deprecated: should use smvDescead
[warn]     val res1 = df.groupBy(df("a")).agg(functions.count(df("a")) withdesc as "c")
[warn]                                                                 ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc59: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val srdd1 = createSchemaRdd("a:Integer; b:Double; c:String",
[warn]                 ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc66: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val srdd2 = createSchemaRdd("a2:Integer; c:String",
[warn]                 ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc83: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val srdd1 = createSchemaRdd("a:Integer; b:Double; C:String",
[warn]                 ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc88: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val srdd2 = createSchemaRdd("a2:Integer; c:String",
[warn]                 ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc99: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val srdd1 = createSchemaRdd("a:Integer; b:Double; c:String",
[warn]                 ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc06: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val srdd2 = createSchemaRdd("a:Integer; c:String",
[warn]                 ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc22: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val df1 = createSchemaRdd("a:Integer;b:String", """1,x1;2,y1;3,z
[warn]               ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc23: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val df2 = createSchemaRdd("a:Integer;b:String", """1,x2;4,w2;"""
[warn]               ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc34: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val df1 = createSchemaRdd("k1:Integer;k2:Integer;a:String", "1,1,2,x2;2,1,x3;2,2,x4")
[warn]               ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc35: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val df2 = createSchemaRdd("k1:Integer;k2:Integer;b:String", "1,1,3,y2;3,1,y3;3,3,y4")
[warn]               ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc49: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val df1 = createSchemaRdd("a:Integer;b:String", """1,x1;2,y1;3,z
[warn]               ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc50: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val df2 = createSchemaRdd("a:Integer;b:String", """1,x1;4,w2;"""
[warn]               ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc51: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val df3 = createSchemaRdd("a:Integer;b:String", """1,x3;5,w3;"""
[warn]               ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc75: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val df = createSchemaRdd("a:Integer; b:Double; c:String",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc02: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val df = createSchemaRdd("a:Integer; b:Double; c:String",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc17: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val df = createSchemaRdd("a:Integer; b:Double; c:String",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc32: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val df = createSchemaRdd("a:Integer; b:Timestamp[yyyyMMdd]",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc49: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val s1 = createSchemaRdd("k: String", "a;b;c")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc50: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val s2 = createSchemaRdd("k: String", "a;b;c;d")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc51: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val s3 = createSchemaRdd("k: String", "c;d")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc66: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val a = createSchemaRdd("key:String", "a;b;c;d;e;f;g;h;i;j;k")
[warn]             ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc81: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val a = createSchemaRdd("key:String", "a;b;c;d;e;f;g;h;i;j;k")
[warn]             ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc03: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val a = createSchemaRdd("key:String", "a;b;c;d;e;f;g;h;i;j;k")
[warn]             ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SRDDFuncsTest.sc15: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom id
[warn]     val a = createSchemaRdd("a:String; b:String; c:String",
[warn]             ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SchemaTest.scala method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("a:Timestamp", "2011-09-03 10:13:58.0")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SchemaTest.scala method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("a:Date", "2011-09-03")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SchemaTest.scala method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("a:Integer; b:Array[Double]",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SchemaTest.scala method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("""k:String; t:Integer @metadata={"smvD"the time sequence"}; v:Double""", "z,1,0.2;z,2,1.4;z,5,2.2;a,1,0.3;")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvCDSTest.scalamethod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inste
[warn]     val df = createSchemaRdd("k:String; t:Integer; v:Double", "z,1,02,1.4;z,5,2.2;a,1,0.3;")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvCDSTest.scalamethod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inste
[warn]     val df = createSchemaRdd("k:String; t:Integer; v:Double", "z,1,02,1.4;z,5,2.2;a,1,0.3;")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvCDSTest.scalamethod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inste
[warn]     val df = createSchemaRdd("k:String; t:Integer; v:Double", "z,1,02,1.4;z,5,2.2;a,1,0.3;")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvCDSTest.scalamethod createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inste
[warn]     val df = createSchemaRdd("k:String; t:Integer; v:Double", "z,1,02,1.4;z,5,2.2;a,1,0.3;")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvCDSTest.scala method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("k:String; t:Integer; v:Double", "z,1,02,1.4;z,5,1.2;z,5,2.2;a,1,0.3;")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvCDSTest.scala method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("k:String; t:Integer; v:Double",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvCDSTest.scala method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("k:String; t:Integer; v:Double",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvCDSTest.scala method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("k:String; t:Integer; v:Double", "z,1,02,1.4;z,5,2.2;a,1,0.3;")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvCDSTest.scala method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("k:String; t:Integer; v:Double", "z,1,02,1.4;z,4,0.2;z,5,2.2;z,6,0.1;a,1,0.3;")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvCDSTest.scala method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("k:String; t:Integer; v:Double", "z,1,02,1.4;z,4,0.2;z,5,2.2;z,6,0.1;a,1,0.3;")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvCDSTest.scala method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("t:Timestamp[yyyyMMdd]", "19760131;201220120229")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvCDSTest.scala method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("t:Timestamp[yyyyMMdd]", "19760131;201220120229")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvCDSTest.scala method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("t:Timestamp[yyyyMMdd]", "19760131;201220120229")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvCDSTest.scala method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("t:Timestamp[yyyyMMdd]", "19760131;201220120229")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvCDSTest.scala method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("k:String; t:Integer; v:Double", "z,1,02,1.4;z,4,0.2;z,5,2.2;z,6,0.1;a,1,0.3;")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvCDSTest.scala method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("k:String; t:Integer; v:Double", "z,1,02,1.4;z,4,0.2;z,5,2.2;z,6,0.1;a,1,;")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvChunckTest.sc2: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom in
[warn]     val df = createSchemaRdd("k:String;v:String", "k1,a;k1,b;k2,d;k2
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvChunckTest.sc6: method chunkBy in class SmvDFHelper is deprecated: will rename and refinerface
[warn]     val res = df.orderBy('k.asc, 'v.asc).chunkBy('k)(runCatFunc)
[warn]                                          ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvChunckTest.sc1: method chunkByPlus in class SmvDFHelper is deprecated: will rename and r interface
[warn]     val res2 = df.orderBy('k.asc, 'v.asc).chunkByPlus('k)(runCatFunc
[warn]                                           ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvGroupedDataTeala:20: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrstead
[warn]     val df = createSchemaRdd("k:String; v:Integer;",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvGroupedDataTeala:37: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrstead
[warn]     val df = createSchemaRdd("k:String; v:Integer;",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvGroupedDataTeala:55: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrstead
[warn]     val df = createSchemaRdd("k:String; t:Integer; v:Double", "z,1,02,1.4;z,5,2.2;a,1,0.3;")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvGroupedDataTeala:67: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrstead
[warn]     val df = createSchemaRdd("k:String; v:String; t:Integer", "1,a,12;1,a,3;1,d,1")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvGroupedDataTeala:80: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrstead
[warn]     val df = createSchemaRdd("k:String; t:Integer; v:String", "a,1,;;a,3,b;a,4,")
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvHierarchyTesta:49: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFromead
[warn]     val df = createSchemaRdd("id:String;zip3:String;terr:String;div:g;v:Double",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvLabelTest.sca method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]   def fixture = createSchemaRdd("id:Integer;name:String;sex:String",dam,male;2,Eve,female")
[warn]                 ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvLabelTest.sca method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]   def descriptionDF = createSchemaRdd("variables:String;decriptions:g",
[warn]                       ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/SmvQuantileTest.:30: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom ad
[warn]     val df = createSchemaRdd("g:String; g2:Integer; k:String; junk:S; v:Integer",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/TimePanelTest.sc4: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom in
[warn]     val df = createSchemaRdd("k:Integer; ts:String; v:Double",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/TimePanelTest.sc7: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom in
[warn]     val df = createSchemaRdd("k:Integer; ts:String; v:Double",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/TimePanelTest.sc1: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom in
[warn]     val df = createSchemaRdd("k:Integer; ts:String; v:Double",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/TimePanelTest.sc1: method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom in
[warn]     val df = createSchemaRdd("k:Integer; ts:String; v:Double",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/UnpivotTest.scal method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("id:String; X:String; Y:String; Z:Strin
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/UnpivotTest.scal method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("id:String;A_1:String;A_2:String;B_1:StB_2:String",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/UnpivotTest.scal method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("id:String;A_1:String;A_2:String;B_1:St,
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/UnpivotTest.scal method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd("id:String;A_1:String;A_2:String;B_1:StB_2:String",
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/UnpivotTest.scal method createSchemaRdd in trait SmvTestUtil is deprecated: Use dfFrom inst
[warn]     val df = createSchemaRdd(schema, data)
[warn]              ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/matcher/SmvEntitherTest.scala:22: method createSchemaRdd in trait SmvTestUtil is deprecated dfFrom instead
[warn]   def createDF1 = createSchemaRdd(
[warn]                   ^
[warn] /home/lbarlow/SMV/src/test/scala/org/tresamigos/smv/matcher/SmvEntitherTest.scala:29: method createSchemaRdd in trait SmvTestUtil is deprecated dfFrom instead
[warn]   def createDF2 = createSchemaRdd(
[warn]                   ^
[warn] 150 warnings found
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.proper
16/08/05 12:58:09 INFO Remoting: Starting remoting
16/08/05 12:58:09 INFO Remoting: Remoting started; listening on addresses :.tcp://sparkDriver@192.168.0.51:37884]
16/08/05 12:58:10 INFO Persistence: Property hive.metastore.integral.jdo.pun unknown - will be ignored
16/08/05 12:58:10 INFO Persistence: Property datanucleus.cache.level2 unknowill be ignored
16/08/05 12:58:18 INFO Datastore: The class "org.apache.hadoop.hive.metastodel.MFieldSchema" is tagged as "embedded-only" so does not have its own date table.
16/08/05 12:58:18 INFO Datastore: The class "org.apache.hadoop.hive.metastodel.MOrder" is tagged as "embedded-only" so does not have its own datastoree.
16/08/05 12:58:22 INFO Datastore: The class "org.apache.hadoop.hive.metastodel.MFieldSchema" is tagged as "embedded-only" so does not have its own date table.
16/08/05 12:58:22 INFO Datastore: The class "org.apache.hadoop.hive.metastodel.MOrder" is tagged as "embedded-only" so does not have its own datastoree.
16/08/05 12:58:24 INFO Datastore: The class "org.apache.hadoop.hive.metastodel.MResourceUri" is tagged as "embedded-only" so does not have its own date table.
16/08/05 12:58:25 INFO Persistence: Property hive.metastore.integral.jdo.pun unknown - will be ignored
16/08/05 12:58:25 INFO Persistence: Property datanucleus.cache.level2 unknowill be ignored
16/08/05 12:58:33 INFO Datastore: The class "org.apache.hadoop.hive.metastodel.MFieldSchema" is tagged as "embedded-only" so does not have its own date table.
16/08/05 12:58:33 INFO Datastore: The class "org.apache.hadoop.hive.metastodel.MOrder" is tagged as "embedded-only" so does not have its own datastoree.
16/08/05 12:58:37 INFO Datastore: The class "org.apache.hadoop.hive.metastodel.MFieldSchema" is tagged as "embedded-only" so does not have its own date table.
16/08/05 12:58:37 INFO Datastore: The class "org.apache.hadoop.hive.metastodel.MOrder" is tagged as "embedded-only" so does not have its own datastoree.
16/08/05 12:58:39 INFO Datastore: The class "org.apache.hadoop.hive.metastodel.MResourceUri" is tagged as "embedded-only" so does not have its own date table.
[info] SmvGroupedDataTest:
[info] - Test the Scale function
[info] - Test the SmvScale with withZeroPivot set
[info] - Test smvRePartition function
[info] - test fillExpectedWithNull
[info] - test fillNullWithPrevValue
[info] CmdLineArgsTest:
[info] - test command line parser
[info] - test command line parser with default args.
[info] SmvConfigTest:
[info] - test smv-app-dir
[info] - test basic props override/priority
[info] - test stage configuration
[info] - test EDD args
[info] - test input/output/data dir command line override
[info] - should report non-existing modules
[info] - should find a module by its basename
[info] - should resolve name ambiguity if only 1 is an SmvModule
[info] - should report ambiguous module names
[info] - should recursively search package namespace
[info] - should resolve name ambiguity by prepending a containing package n
[info] ServerResponseTest:
[info] - test OK Server Response Marshall
[info] - test OK Server Response De-Marshall
[info] - test ERROR Server Response Marshall
[info] - test ERROR server Response De-Marshall
[info] SmvChunkTest:
[info] - Test chunkBy
[info] DSDependencyTest:
[info] - test DataSetDependency, asm based dependency derivation
[info] SmvPivotTest:
[info] - Test creation of unique column names
[info] - Test creation of unique column names with missing/non-id data
[info] - Test creation of unique column names with 1 pivot column
[info] - test smvPivot on DF
[info] - test smvPivotSum on GD
[info] - Test smvPivot with pivotColSets
[info] - Test pivot_sum function
[info] - Test pivot_sum function with float value
[info] SmvPivotCoalesceTest:
[info] - SmvPivotCoalesce should coalesce pivoted columns
[info] - SmvPivotCoalesce should ignore values not included in specified baput
[info] - SmvPivotCoalesce should use in-group rank as the pivot column if pcolumns are unspecified
[info] - The starting value for in-group ranking should be 0
[info] - SmvPivotCoalesce should derive baseOutput from the distinct valuesalue columns if baseOutput is unspecified
{
  "passed":false,
  "errorMessages": [
    {"FailTotalRuleCountPolicy(2)":"true"},
    {"FailTotalFixCountPolicy(1)":"false"},
    {"FailParserCountPolicy(1)":"true"}
  ],
  "checkLog": [
    "Rule: b_lt_03, total count: 1",
    "org.tresamigos.smv.dqm.DQMRuleError: b_lt_03 @FIELDS: b=0.5",
    "Fix: a_lt_1_fix, total count: 1"
  ]
}
{
  "passed":false,
  "errorMessages": [
    {"FailTotalRuleCountPolicy(3)":"false"},
    {"FailParserCountPolicy(1)":"true"}
  ],
  "checkLog": [
    "Rule: BoundRule(a), total count: 1",
    "org.tresamigos.smv.dqm.DQMRuleError: BoundRule(a) @FIELDS: a=2",
    "Rule: SetRule(b), total count: 1",
    "org.tresamigos.smv.dqm.DQMRuleError: SetRule(b) @FIELDS: b=o",
    "Rule: FormatRule(c), total count: 1",
    "org.tresamigos.smv.dqm.DQMRuleError: FormatRule(c) @FIELDS: c=zz"
  ]
}
{
  "passed":true,
  "errorMessages": [
    {"FailTotalFixCountPolicy(5)":"true"},
    {"FailParserCountPolicy(1)":"true"}
  ],
  "checkLog": [
    "Fix: SetFix(b), total count: 1",
    "Fix: FormatFix(c), total count: 1"
  ]
}
{
  "passed":false,
  "errorMessages": [
    {"udp":"false"},
    {"FailParserCountPolicy(1)":"true"}
  ],
  "checkLog": [
    "Rule: rule1, total count: 1",
    "org.tresamigos.smv.dqm.DQMRuleError: rule1 @FIELDS: b=0.5",
    "Fix: fix2, total count: 1"
  ]
}
[info] DQMTest:
[info] - test DQMState functions
[info] - test DQMRule
[info] - test DQMFix
[info] - test SmvDQM with FailAny (so FailCount)
[info] - test FailPercent
[info] - test Total Policies
[info] - test dqm method in SmvDataSet
[info] - test additional DQMRules
[info] - test additional DQMFixes
[info] - test user defined policy
[info] RankTest:
[info] - Test the SmvRank function
[info] StringMetricUdfTest:
[info] Levenshtein distance function
[info] - should return normalized values
[info] - should return None when either string is null or both are empty
[info] Soundex function
[info] - should return None when either string is null or both are empty
[info] nGram2 function
[info] - should return None when either string is null or both are empty
[info] nGram3 function
[info] - should return None when either string is null or both are empty
[info] DiceSorensenFn function
[info] - should return None when either string is null or both are empty
[info] JaroWinklerFn function
[info] - should return None when either string is null or both are empty
[info] ClassFinderTest:
[info] - find valid class object
[info] - find invalid class object
[info] - find valid resource object
[info] - find invalid resource object
[info] SmvLabelTest:
[info] - labeling a column should not affect other columns
[info] - labeling columns should not alter the data in the data frame
[info] - labeling a column should preserve previous meta data on the column
[info] - labeling a column twice should have the same effect as labeling on
[info] - columns can have multiple labels
[info] - removing labels should preserve other meta data
[info] - removing one label should preserve other labels
[info] - calling smvRemoveLabel with zero column arguments would remove theified label from all columns
[info] - calling smvRemoveLabel with zero label argument would remove all l from the specified columns
[info] - calling smvRemoveLabel with two empty parameter lists should clearlabel meta data
[info] - selecting labeled columns should return only columns that have allspecified labels
[info] - calling smvWithLabel with an empty argument list should return unld columns
[info] - smvWithLabel should throw instead of returning an empty list of co
[info] - adding description should be able to read out the same
[info] - adding description to a column should preserve previous meta data e column
[info] - removeDesc should remove all desc with empty parameter
[info] - adding description through DF should generate correct descriptions
12:58:50 PERSISTING: target/scala-2.10/test-classes/data/org.tresamigos.smvinkFollowTest/output/org.tresamigos.smv.smvLinkTestPkg1.Y_dd3cf583.csv
12:58:51 RunTime: 454 milliseconds, N: 3
12:58:51 PERSISTING: target/scala-2.10/test-classes/data/org.tresamigos.smvinkFollowTest/output/org.tresamigos.smv.smvLinkTestPkg2.T_eeb7869b.csv
12:58:51 RunTime: 360 milliseconds, N: 3
[info] SmvLinkFollowTest:
[info] - Test SmvModuleLink follow link
[info] - Test SmvModuleLink datasetHash follows linked module
[info] SmvLinkFollowWithVersionTest:
[info] - Test SmvModuleLink datasetHash follow link version
[info] - Test SmvModuleLink follow link with version config
{
  "passed":true,
  "errorMessages": [

  ],
  "checkLog": [
    "java.lang.IllegalArgumentException: requirement failed @RECORD: 123,12,12102012",
    "java.lang.NumberFormatException: For input string: \"001x\" @RECORD: 11x  ,20130109130619,12102012",
    "java.text.ParseException: Unparseable date: \"130109130619\" @RECORD: 2.50  ,130109130619,12102012",
    "java.text.ParseException: Unparseable date: \"109130619\" @RECORD: 1230  ,109130619,12102012",
    "java.text.ParseException: Unparseable date: \"201309130619\" @RECORD: 2.50  ,201309130619,12102012"
  ]
}
{
  "passed":false,
  "errorMessages": [
    {"FailParserCountPolicy(1)":"false"}
  ],
  "checkLog": [
    "java.text.ParseException: Unparseable date: \"130109130619\" @RECORD: 2.50  ,130109130619,12102012",
    "java.text.ParseException: Unparseable date: \"109130619\" @RECORD: 1230  ,109130619,12102012",
    "java.text.ParseException: Unparseable date: \"201309130619\" @RECORD: 2.50  ,201309130619,12102012",
    "java.lang.IllegalArgumentException: requirement failed @RECORD: 123,12,12102012",
    "java.lang.NumberFormatException: For input string: \"001x\" @RECORD: 11x  ,20130109130619,12102012"
  ]
}
{
  "passed":true,
  "errorMessages": [
    {"FailParserCountPolicy(10)":"true"}
  ],
  "checkLog": [
    "java.text.ParseException: Unparseable date: \"130109130619\" @RECORD: 2.50  ,130109130619,12102012",
    "java.text.ParseException: Unparseable date: \"109130619\" @RECORD: 1230  ,109130619,12102012",
    "java.text.ParseException: Unparseable date: \"201309130619\" @RECORD: 2.50  ,201309130619,12102012",
    "java.lang.IllegalArgumentException: requirement failed @RECORD: 123,12,12102012",
    "java.lang.NumberFormatException: For input string: \"001x\" @RECORD: 11x  ,20130109130619,12102012"
  ]
}
{
  "passed":false,
  "errorMessages": [
    {"FailParserCountPolicy(1)":"false"}
  ],
  "checkLog": [
    "java.io.IOException: Un-terminated quoted field at end of CSV line @RE 231,67.21  ,20121009101621,\"02122011"
  ]
}
{
  "passed":true,
  "errorMessages": [

  ],
  "checkLog": [
    "java.io.IOException: Un-terminated quoted field at end of CSV line @RE 231,67.21  ,20121009101621,\"02122011"
  ]
}
[info] RejectTest:
[info] - test csvFile loader rejection with NoOp
[info] - test csvFile loader rejection with exception
[info] - test csvFile loader with FailParserCountPolicy
[info] - test csvParser rejection with exception
[info] - test csvParser rejection
{
  "passed":true,
  "errorMessages": [

  ],
  "checkLog": [
    "java.lang.StringIndexOutOfBoundsException: String index out of range: CORD: 123",
    "java.lang.StringIndexOutOfBoundsException: String index out of range: CORD: 00"
  ]
}
[info] FrlTest:
[info] - test frlFile loader with NoOp rejectlogger
[info] SmvFileTest:
[info] - test SmvFile full path
[info] - test SmvModuleLink can link to an SmvFile
[info] - read dir using SmvMultiCsvFiles
[info] SmvReflectionTest:
[info] - Test SmvReflection.objectsInPackage method.
12:58:53 PERSISTING: target/scala-2.10/test-classes/data/org.tresamigos.smvierarchyTest/output/org.tresamigos.smv.hierTestPkg1.GeoMapFile_3abf6188.csv
12:58:53 RunTime: 227 milliseconds, N: 7
12:58:54 PERSISTING: target/scala-2.10/test-classes/data/org.tresamigos.smvierarchyTest/output/org.tresamigos.smv.SmvHierarchyTestanonfun2TestModule2_c12.csv
12:58:54 RunTime: 834 milliseconds, N: 9
[info] SmvHierarchyTest:
[info] - Test SmvHierarchyFuncs
[info] - module with name column test
[info] - SmvHierarchies with parent
[info] - SmvHierarchies appendParentValues test
[info] ValidationTest:
[info] - Test ValidationResult json convertion test
[info] - Test ValidationResult ++ operator
[info] NonAggFuncsTest:
[info] - test smvStrCat
[info] - smvStrCat(ws, cols) should yield null if all columns are null
[info] - test smvAsArray
[info] - test smvCreateLookUp
[info] - smvCountTrue should count columns with true values
[info] - smvCountFalse should count columns with false values
[info] - smvCountNull should count columns with null values
[info] - test smvCountDistinctWithNull
[info] - test smvBoolsToBitmap
[info] - test collectSet for String
[info] - test collectSet for Integer
[info] - test collectSet for Boolean
[info] - test collectSet for Double
[info] - test smvArrayCat
[info] - test smvHashKey
[info] SmvHDFSTest:
[info] - Test HDFS delete file operation
[info] - Test HDFS list directory operation
[info] - Test HDFS list non-existent directory
[info] - Test the basename function in HDFS
[info] - Test purging old files from directory
[info] - Test file modificationTime
[info] - Test HDFS file read
[info] - Test HDFS file write
[info] StringConversionUtilTest:
[info] StringConversionUtil
[info] - should be able to convert integers
[info] - should use Long when the number approaches threshold for Int
[info] - should be able to convert floats
[info] - should use doble when the number approaches threshold for Float
[info] SmvQuantileTest:
[info] - Test smvDecile
[info] DoubleBinHistogramTest:
[info] - Test the smvDoubleBinHistogram function with single key, single va
[info] - Test the smvDoubleBinHistogram function with multi-keys, multi-val
[info] - Test the smvDoubleBinHistogram function with multi-keys, multi-valsing default num of bins
[info] - Test the smvDoubleBinHistogram column post fix
[info] SmvStagesTest:
[info] - Test getAllPackageNames method.
[info] SmvMultiStageTest:
[info] - Test modules in stage.
[info] - test ancestors/descendants method of stage
[info] - test deadDataSets/leafDataSets
[info] - Test findStageForDataSet
[info] SmvWhatModulesToRunTest:
[info] - Test modules to run (non-output module)
[info] - Test modules to run (mods in stage)
[info] - Test modules to run (mods in app)
[info] SchemaDiscoveryTest:
[info] - Test schema discovery 1 line header
[info] - Test schema discovery no header
[info] - Test schema discovery type promotion
[info] - Test schema discovery with parser errors
[info] - Test schema discovery with parser errors on all data lines
[info] ClassCRCTest:
[info] - test two classes have different CRC
[info] - test same class has same CRC
[info] - test for invalid class name CRC
[info] - Adding comments to source code should not change bytecode checksumIGNORED !!!
[info] - Updating referenced constants should change bytecode checksum !!! ED !!!
[info] - #316: Changing code should result in checksum change !!! IGNORED !
[info] - Changing base class should result in checksum change !!! IGNORED !
[info] - #319: Changing configuration should result in checksum change !!! ED !!!
[info] TimePanelTest:
[info] - test addToDF
[info] - test addTimePanels DF helper
[info] - test timePanelValueFill DF helper
[info] - test addTimePanelsWithValueFill DF helper
[info] EddTest:
[info] - test EddResult Report
[info] - test EddResult equals
[info] - test EddResult Hist equals
[info] - test Edd dataPathToEddPath
16/08/05 12:59:05 ERROR Utils: Uncaught exception in thread driver-heartbea
java.io.IOException: java.lang.ClassCastException: cannot assign instance ola.collection.immutable.HashMap$SerializationProxy to field org.apache.sparcutor.TaskMetrics._accumulatorUpdates of type scala.collection.immutable.Mainstance of org.apache.spark.executor.TaskMetrics
        at org.apache.spark.util.Utils$.tryOrIOException(Utils.scala:1163)
        at org.apache.spark.executor.TaskMetrics.readObject(TaskMetrics.sca9)
        at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodsorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.jav7)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:
        at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.j801)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:135
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371)
        at org.apache.spark.util.Utils$.deserialize(Utils.scala:91)
        at org.apache.spark.executor.Executor$$anonfun$org$apache$spark$exe$Executor$$reportHeartBeat$1$$anonfun$apply$6.apply(Executor.scala:440)
        at org.apache.spark.executor.Executor$$anonfun$org$apache$spark$exe$Executor$$reportHeartBeat$1$$anonfun$apply$6.apply(Executor.scala:430)
        at scala.Option.foreach(Option.scala:236)
        at org.apache.spark.executor.Executor$$anonfun$org$apache$spark$exe$Executor$$reportHeartBeat$1.apply(Executor.scala:430)
        at org.apache.spark.executor.Executor$$anonfun$org$apache$spark$exe$Executor$$reportHeartBeat$1.apply(Executor.scala:428)
        at scala.collection.Iterator$class.foreach(Iterator.scala:727)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
        at scala.collection.IterableLike$class.foreach(IterableLike.scala:7
        at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
        at org.apache.spark.executor.Executor.org$apache$spark$executor$Exe$$reportHeartBeat(Executor.scala:428)
        at org.apache.spark.executor.Executor$$anon$1$$anonfun$run$1.apply$p(Executor.scala:472)
        at org.apache.spark.executor.Executor$$anon$1$$anonfun$run$1.apply(tor.scala:472)
        at org.apache.spark.executor.Executor$$anon$1$$anonfun$run$1.apply(tor.scala:472)
        at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1
        at org.apache.spark.executor.Executor$$anon$1.run(Executor.scala:47
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.ja1)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureaccess$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFuturerun(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecjava:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassCastException: cannot assign instance of scala.coion.immutable.HashMap$SerializationProxy to field org.apache.spark.executorMetrics._accumulatorUpdates of type scala.collection.immutable.Map in instaf org.apache.spark.executor.TaskMetrics
        at java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(ObjecamClass.java:2089)
        at java.io.ObjectStreamClass.setObjFieldValues(ObjectStreamClass.ja61)
        at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.ja06)
        at java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.ja1)
        at org.apache.spark.executor.TaskMetrics$$anonfun$readObject$1.appl$sp(TaskMetrics.scala:220)
        at org.apache.spark.util.Utils$.tryOrIOException(Utils.scala:1160)
        ... 32 more
[info] EddTaskTest:
[info] - test EddTask AvgTask
[info] - test EddTask StdDevTask
[info] - test EddTask CntTask
[info] - test EddTask MinTask
[info] - test EddTask MaxTask
[info] - test EddTask StringMinLenTask
[info] - test EddTask StringMaxLenTask
[info] - test EddTask StringDistinctCountTask
[info] - test EddTask AmountHistogram
[info] - test EddTask BinNumericHistogram
[info] - test EddTask YearHistogram
[info] - test EddTask MonthHistogram
[info] - test EddTask DoWHistogram
[info] - test EddTask HourHistogram
[info] - test EddTask BooleanHistogram
[info] - test EddTask StringByKeyHistogram
[info] - test EddTask StringByFreqHistogram
[info] - test EddSummary
[info] - test edd summary with decimal
[info] - test EddResult DF compare
[info] - test null handling in histogram
[info] - test Null rate
12:59:11 PERSISTING: target/scala-2.10/test-classes/data/org.tresamigos.smvSPersistTest/output/org.tresamigos.smv.dspersistPkg.X_cd0a9917.csv
12:59:11 RunTime: 207 milliseconds, N: 4
12:59:11 PERSISTING: target/scala-2.10/test-classes/data/org.tresamigos.smvSPersistTest/output/org.tresamigos.smv.dspersistPkg.Y_29d33416.csv
12:59:11 RunTime: 299 milliseconds, N: 4
[info] SmvDSPersistTest:
[info] - test read back persisted module with meta data
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further ds.
16/08/05 12:59:12 INFO metastore: Mestastore configuration hive.metastore.wuse.dir changed from file:/tmp/warehouse--5261f3bd-9cff-4e08-8111-b01241ee5to file:///home/lbarlow/SMV/target/scala-2.10/test-classes/data/org.tresamimv.SmvHiveTableTest
16/08/05 12:59:12 INFO Query: Reading in results for query "org.datanucleuse.rdbms.query.SQLQuery@0" since the connection used is closing
16/08/05 12:59:12 INFO log: Updating table stats fast for bar
16/08/05 12:59:12 INFO log: Updated size of table bar to 0
16/08/05 12:59:13 INFO ParseDriver: Parsing command: select * from bar
16/08/05 12:59:13 INFO ParseDriver: Parse Completed
[info] SmvHiveTableTest:
[info] - test SmvHiveTable read
[info] BoundedPriorityQueueTest:
[info] - Test bounded queue order
[info] - Test small bounded queue
[info] - Test duplicate values bounded queue
[info] SelectWithReplaceTest:
[info] - should add new columns without modification
[info] - should overwrite existing column with the same name
[info] - should accept a column aliased multiple times
[info] SelectPlusMinusTest:
[info] - test SelectPlus
[info] - test SelectPlusPrefix
[info] - test SelectMinus
[info] - test selectExpandStruct
[info] renameFieldTest:
[info] - test rename fields
[info] - test rename to existing field
[info] - test prefixing field names
[info] - test postfixing field names
[info] - rename field should preserve metadata in renamed fields
[info] - rename field should preserve metadata for unrenamed fields
[info] JoinHelperTest:
[info] - test joinUniqFieldNames
[info] - test joinUniqFieldNames with ignore case
[info] - test joinByKey
[info] - outer joinByKey with single key column
[info] - outer joinByKey with multiple key columns
[info] - joinMultipleByKey
[info] dedupByKeyTest:
[info] - test dedupByKey
[info] - test dedupByKey with nulls
[info] - test dedupByKeyWithOrder
[info] - test dedupByKeyWithOrder with timestamp
[info] smvOverlapCheckTest:
[info] - test smvOverlapCheck
[info] smvHashSampleTest:
[info] - test smvHashSample
[info] smvCoalesceTest:
[info] - Test smvCoalesce
[info] smvPipeCount:
[info] - Test smvPipeCount
[info] OtherDFHelperTest:
[info] - Test smvDiscoverPK
[info] SmvSchemaTest:
[info] - Test schema string parsing
[info] - Test schema file parsing
[info] - Schema entry equality
[info] - Test Decimal formats
[info] - Test Decimal value serialize
[info] - Test Decimal default format
[info] - Test Timestamp Format
[info] - Test Serialize Map Values
[info] - Test Serialize Array Values
[info] - Test Serialize with null values
[info] - Test Timestamp in file
[info] - Test Timestamp default format
[info] - Test Date default format
[info] - Test schema name derivation from data file path
[info] - Test mapping values to valid column names
[info] - Test ArraySchema read and write
[info] - Test schema extractCsvAttributes
[info] - Test schema extractCsvAttributes defaults
[info] - Test schema addCsvAttributes
[info] - test metadata read and write
[info] UnpivotTest:
[info] - Test simple unpivot op
[info] - multi-column unpivot should be the inverse of pivot
[info] - multi-column unpivot should preserve and padd with null
[info] - unpivoted dataframe should not have an index column if user specifo skip
[info] - index ordering should put 2 before 10
[info] SmvEntityMatcherTest:
[info] - Main name matcher: all parameters
[info] - Main name matcher: only fuzzy level
[info] - Main name matcher: only exact level
[info] - Main name matcher: only exact and fuzzy levels
[info] - Main name matcher: common + exact & fuzzy
[info] - Main name matcher: filter + exact & fuzzy
[info] ExactMatchFilterTest:
[info] - Test the filter
[info] FuzzyLevelMatcherTest:
[info] - Fuzzy level matcher: column name functions
[info] - Fuzzy level matcher parameters: null exact, fuzzy
[info] - Fuzzy level matcher parameters: exact, null fuzzy
[info] - Fuzzy level matcher parameters: exact and fuzzy
[info] NoOpExactMatchFilterTest:
[info] - No-op filter
[info] CommonLevelMatcherNoneTest:
[info] - No-op filter
[info] ExactLevelMatcherTest:
[info] - Exact level matcher: all parameters
[info] - Exact level matcher: null column name
[info] ColumnHelperTest:
[info] - test smvNullSub
[info] - test smvLength
[info] - test smvStrToTimestamp
[info] - test smvYear, smvMonth, smvQuarter, smvDayOfMonth, smvDayOfWeek
[info] - test smvAmtBin, smvNumericBin, smvCoarseGrain
[info] - test SmvSoundex function
[info] - test SmvMetaphone function
[info] - test smvPlusDays/smvPlusMonths/smvPlusWeeks/smvPlusYears
[info] - test smvDay70/smvMonth70
[info] - test withDesc
[info] - test Percentile of DoubleBinHistogram
[info] - test Mode of DoubleBinHistogram: equal mode values
[info] - test Mode of DoubleBinHistogram: different mode values
[info] - test isAnyIn
[info] - test isAllIn
[info] - test containsAll
[info] - test smvTime helpers
[info] SmvPrintToStrTest:
[info] - test smvPrintToStr
[info] SmvStrTrimTest:
[info] - test smvStrTrim
[info] SmvSafeDivTest:
[info] - test SmvSafeDiv function
[info] SmvAppDynamicResolveTest:
[info] - test SmvApp.dynamicResolveRDD function
Starting class server on port: 9999
[info] RemoteClassLoaderTest:
[info] - test remote class loader server valid class
[info] - test remote class loader server class not found
[info] - test class loader server not started
[info] LocalClassLoaderTest:
[info] - test local class loader valid class
[info] - test local class loader class not found
[info] ClassLoaderFactoryTest:
[info] - test SmvClassLoader client factory for remote server config
[info] - test SmvClassLoader client factory for local client config
[info] - test SmvClassLoader client factory for default config
[info] SmvGraphUtilTest:
[info] - Test list modules
[info] - Test createGraphvisCode
[info] - Test createDSAsciiGraph
[info] - Test createStageAsciiGraph
[info] - Test createGraphJSON *** FAILED ***
[info]   4 did not equal 3 (SparkTestUtil.scala:127)
[info] DataTypeHelperTest:
[info] - test getOrdering
[info] - test getNumeric
[info] SmvHashOfHashTest:
[info] - Test module hashOfHash
[info] SmvNewAppTest:
[info] - test newApp function
[info] SmvAppTest:
[info] - Test normal dependency execution
[info] - Test cycle dependency execution
[info] - Test SmvFile crc
[info] SmvAppPurgeTest:
[info] - Test purgeOldOutputFiles
[info] AggFuncsTest:
[info] - test OnlineStdDev
[info] - test Histogram
[info] - test DoubleBinHistogram
[info] - test SmvFirst
[info] - test smvSum0
[info] - test smvIsAny
12:59:27 PERSISTING: target/scala-2.10/test-classes/data/org.tresamigos.smvest/output/org.tresamigos.smv.CsvTestanonfun6A2_c8ba86a7.csv
12:59:28 RunTime: 108 milliseconds, N: 3
[info] CsvTest:
[info] - Test loading of csv file with header
[info] - Test column with pure blanks converts to null as Integer or Double
[info] - Test run method in SmvFile
[info] - Test reading CSV file with attributes in schema file.
[info] - Test writing CSV file with attributes in schema file.
[info] - Test persisting file with null strings
[info] - Test escaping quotes in strings
[info] PublishTest:
[info] - Test module publish
[info] SmvCDSTest:
[info] - test simple runAgg
[info] - Test runAgg
[info] - test runAggPlus
[info] - Test agg with no-from-aggregation
[info] - Test SmvTopNRecsCDS
[info] - SmvGroupedData.smvTopNRecs should return all rows if n >= row_coun
[info] - SmvGroupedData.smvTopNRecs should return any in the top n range ife are > n rows with the same value
[info] - Test Lag inplemented with InLastN
[info] - Test CDS Chaining compare
[info] - Test CDS Chaining
[info] - Test CDS Chaining with smvMapGroup
[info] - Test TimeInLastNDays
[info] - Test TimeInLastNMonths
[info] - Test TimeInLastNWeeks
[info] - Test TimeInLastNYears
[info] - Test Before
[info] - Test keep none-travial expression
[info] ModuleCrcConsistencyTest:
[info] - test moduleCrc changed or not
[info] - test moduleCrc on SmvFile
[info] RollupCubeOpTest:
[info] - Test cube bitmask creation
[info] - Test rollup bitmask creation
[info] - Test getNonRollupCols
[info] - Test createSRDDWithSentinel
[info] - Test duplicateSRDDByBitmasks
[info] - Test cube
[info] - Test rollup
[info] AsmUtilTest:
[info] AsmUtil.hasAnonfun
[info] - should identify modules with anonymous functions
[info] - should not identify modules with no anonymous functions
[info] Run completed in 1 minute, 25 seconds.
[info] Total number of tests run: 331
[info] Suites: completed 76, aborted 0
[info] Tests: succeeded 330, failed 1, canceled 0, ignored 5, pending 0
[info] *** 1 TEST FAILED ***
[error] Failed tests:
[error]         org.tresamigos.smv.SmvGraphUtilTest
[error] (test:test) sbt.TestsFailedException: Tests unsuccessful
[error] Total time: 117 s, completed Aug 5, 2016 12:59:34 PM
Kai-Chen commented 8 years ago

This is probably a subtle bug in SBT test runner. If you run the test by itself with testOnly org.tresamigos.smv.SmvGraphUtilTest, the test passes. Also if you use scala 2.11, the entire test suites also pass.

laneb commented 7 years ago

In order to standardize on SBT (#464), we should ensure that the test suite passes in SBT despite any bugs in SBT.

Kai-Chen commented 7 years ago

The test now passes, though there is still a deeper and very subtle issue with the combination of chain use of lazy vals and use of non-case-class instances as map keys.

The fix is currently checked into the 2.1 branch, as the test is broken there also. If need be, it can be merged into the master at any time. Otherwise, it's better to wait for the merge of the entire branch.

ninjapapa commented 6 years ago

No more an issue.